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ABSTRACT 

Th^ts three year study compared three organizational 
plans for t:eaching\emedial reading by spending one year each at 
different grade levels: primary, intermediate, and seven-eight, in 
that order. In the first plan a reading consultant tutored childen 
individually .in a reading (clinic. In the second plan a mast^r reading 
teacher provided aid in d^^^'^^iasis, prescription, and 

indivdduali-zation of instruction to classroom teachers who taught the 
remedial readers in their own classrooms. Intensive inservice 
education vas conducted during the three years for the participating 
teachers; a reading materials center was established ^^nd the reading 
clinic resources were made available to all teachers •/StCpontrol group 
w^s selected the second year and did not receive program treatment. 
The results indicated that teacher competency increased in ter.ms of 
five of six behavioral objectives. In the first year no statistical 
difference could be demonstrated in favor of children recei-ving i 
special reading treatment at .the - clinic when compared to like ' ' 
children receiving regular ^l^sroom instruction. During fhe last two 
years of the experiment, students in the regula;r classrooms, whose 
teachers were involved in ins^wice sessions and who had t^ie hel^ of 
master teachers, de^nbnstrated gifeater gains than the 'other two 
groups. ♦MKH) 
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A comparison between remedial reading classroom instruction and spBcial^zed 
remedial reading instruction outside of the regular classroom. 



I. NARRATIVE ^HEPORT. 



A. Program Qoal. 

The basic goal of the program was to establish an inservice training 
program to increase teacher competency in reading, 

B. Program Operation > v 

A language arts reading center. was established,. It served as a demon* 

stration site and as an inservice ti^aiijing center. The demonstratipn site 

consisted of: First, a reading clinic that proyided a remedial reading pro-p 
^^^^ ^ ' 

gram for disabled readers; Second, a reading, materials center that provided 
teacher access to approximately one hundred published materials including 
audio-visual material, basal reading series, standardized reading tests, 
reading journals, various professional books, apd teacher made materiklsf'j and 
Third, an inservice trainiig center that provided for large. group consultajit 

y 

sessions and small group vievjing of vi<^6taped demonstrations of various 
reading instructional techniques^,' 

An i nt-An ?'^ w .^nfiArvl<>p^ -t:rAining program was conducted for the three p^*- 
gram years^ The inservice training program consisted of a minimum of five 
days of summer workshops and nine Saturday workshops during-the course of . 
the scihool year. The workshops were conducted by university personnel w^o 

6^ 
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had demonstrated competency in the*" field of reading.. In conjunction with 
the workshops , each teacher vaaj provided released time a mininma of three 



half--days during the school year. At this time the classroom teacher viewed 



dem onst ra tion •o las ^eg^- ^gmd Gon6ultad-wt4;h- the o l 4me -staff iteaber^^ - The olaes^ 
room teachers received a $1^ stipend for attendance at each session. 

A master teacher cooperating with the fc]^srooiii teacher was also iden* 
tified as a part of the inservice -train.ing^^rogram. , ^ 

The clinic center was made available to the teachers as a reading resource 
center. A complete e;q)lanation of reading resource conce^Tiing reading material 
was presented upon teacher request. 

C. Goal Accoffiplishment. 

Teacher competency vas increased as indicated by the statistical eval* 
uation of Teacher Cfcjective Qne^ (page 52),. Teacher Cfejective Three (page 5U, 
55) and Teacher Objective Four (page 55> 57). A sximraary objecthre identified 
as Teacher Objective ?ive for evaluating teacher competency (page 58) indi- 
cated that the teacher^ demonstrated statistical gain *in relationship to 
competency accomplishment for the second year. Although additional gain was 
indicated for the t^rd program year, the data was not statistical significant. 

D. Unique Aspects of the Program arid Problems Encountered. 

% ' ^ 

^Compari^on-of "two* methods of ;remedial reading instruction. 

The first year of program pperation provided interesting statistical 

results in that no 3t^ti$tical difference could be dei^ja^^strated in favor of 

children receiving special reading treatment at the -clinic when compared to 

•like children receiving regular classroom instruction.* / 

' The program evaluator and^ the clinic staff attributed the failure of the - 

clinic treatment students to demonstrate gain to the success of the inservice 



training program in preparing teachers to deal with children having readin^*'"**^ 

problems in the regular classroom. 

I — ' ...J ^..i-j . „, — ■ >■ — ^ 

The new project director/ William DavlSt 'was employed for the' SQcoyid prO'» 



_4a at^^t^ai % - ifau^estioaed- the result^ <yf 4he -fi rsts project year: and with, thfit .! z. 

assistance of two evaluators, Mr. James Jotason, Ph.D., Psy., and Mr. Gary 
Ramseyer, Ph.D., Psy^, of Illinois Stat^ University, Normal, Illinois, de- 
, termined that an attempt should be matie to compare the clinic approach to 
an approach featuring a specialist assisting the teacher within the classroom. 
Therefore, three groups were established (see II-Evaluatipn Data, page 18). 
The center students were classified as Experimental Group I and received 
a minimum of two, half flays of individualised reading instruction. A master 
teacher possessing major college work in reading was responsible for diag- 

nosing, prescribing and implementing each student's indivldvialized reading 

\ ' ' ■ 

program. • . - - 

The classroc^ students were classified as Experimental Group II and 

rreceived special classroom attention. The master teacher aided the class- 

* room teacher in diagnosing, prescribing and implementing an individualized 

reading program for students who demonstrated reading disabilities. .The 

control school students were identified as Control Group and did not receive 

program treatmenty . ' 

I- 

The statistical resu^l1>s (pajge 19-2U, Part II, Evaluation Data) indicated' 

/ ' ' . 

that the classroom, students identifed as Experimertal Group II demonstrated 

•gre^jter gain in reading than the students attending the center (Experimental 
Group I) and the control school students. The students were compared as a group. 

An attempt ^o classify students Experimental Group II according to the 
willingness ojS the teacher to participate in. the program was not made. Some 
•teachers did |>articipa?te" reluctantly and others gave wholehearted participa- 
ti<i p. Teaches who did not wsmt to participate Md utilize the master teacher 
I V « . 



in a cooperative classrooijt^venture WSsfe required to sign a stateigpit to that 
effect. ' • ^' "i^r"^ ' ■ . 



V 

— : — _ ^-i^ : — \ L__^ 

In essence t^psurbicipating classroom teacher was required to utilize the 

services of a master te^acher* The jaiaster teachers were scheduled -to \spend ^ \ 

a mininmm pf ^ hoUr per week in the cla'saroom with tjfe participating teachers. 

However, the classroom teach^ra felt and expressed to the project director 

dissatisfaction with beihg coerced into utilizing the master teacher. For 

that reason the project director arid the evalu^ors detemined that it was 

• necessary to change the procedure and allow the teachers to utilize the master 

teachers at their option. _ 

^ Therefore the third year of the program differecf only in the procedure 

- of having the mastej^ teacher spend a minimum of one-half hour per week in the 

cras§;room. The classroom teacher was given the option to Aitilize or not to 

utilize the master teacher. The statistical results of the third program 

year demonstrated no statistical difference? alaong Experimental Groxzp I, 

Kjqperimental Group II and th6 Control Group, (See evaluation data 2$ through 30). 

■ \ I ■ ' " 

^» A brief ^summary of major program findli^gs and a rocommendation for a 
research proposal. , ^ 

^,The results of;' comparing pi^ograa year one, yfear two arid year three indi.c&te 

two major conclusions. First, the utilization of a master reading teacher as 
' a cooperative teacWer to aid the cla?sro<^m teacher in diagnosl^^ proscribing . 

and implementing reading programs in the classroom for sitfdents demonstrating' 
reading disabilities is superior to removing children.,with Remonstrated reading . 
disabilities froni.the classroom fo? reading instruction-4)y ^reading specialist. * 
r Second, teachfer competency can be increased by the utilization of an in- 

service training program, but the indication is that the teacher should receive" 
' cooperative classroqii assistance from a reading specialist at least a minimum 
' PR ir" one.-half hour per week on a definite assigned basis. 

51 ' 



A suirvey of reading programs (Title I, E..S.E.A.) indicates that Q2% of 
rem^diaj.' reading programs 'rQBove the student identified as! a disabled reader. 



from the classroom ^or^special reading instruction^ The' results of this pro- 



• gram indicat es that euoTi prao tid e of ^ ■ ^reM o ving st ud e nt s fx)?- s p e^^ 



' ^traction questionable." 

Therefore a longitudinal study should be undertaken to determirie the most 
efficieht means of improving the plight of the disabled reader. It is there- 
^ fore recommended that three groups be established utilizing a statistical 
design that compares large group performance and individual performance and 
reduces.. the number of variables that effect outcomes. 
' The treatment groups should be identified as: 

1. A groups receiving instruction based upon a cooperative master reading 
teacher/classroom teacher diagnosis, prescription and implementation of 
reading programs in "the classroom for students identified as disabled 
readers. 

. • ' . 

2. Master reading teacher who diagnoses, prescribes. and implements a 

« 

i*emedial reading program outside of the regular classrocMn for students 
identified as disabT.eU readers. • * 

•3» A control scl^ool not utilizing the master teacher concept within or 
outside of the classroom. Specifically, the control school would make 
no special .effort to attack the. disabled reading problem other than 
t&ving the regulfu: classrobm teacher deal directly with the problem of 
tbe^. disabled reader. , . . *• 

To guarantee j^articipation and to hold the "halS effect" constant, the , 
groups should be selected from ongoing programs. * 

'Rlis typp of selection, although difficult in the initial group identifica- 

s 

tion stage, will provide the bejt statistical data and will guarantee a truly 

10 ■ 



Random sample'. 



LErIc . . • . \,. .. VII 




be conducted by university personnel and should be conducted oijjiside of the 
regular school setting. 

Th^ data should' provide information concerning: l)/the relationship 
between teacher competency and student jachievement^ 2 ) the efficacy of re- 
medial reading in the classroom, with specialist assistancy as opposed ^.o 
special instruction outside of the regular classroom and 3) the most efficient 
means of increasing teacher competency in relation to reading instruction. 
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Teache/ Ob.ig-ctive One — .^Pirst Year-<^va97'l-72 



Teaokfers in grades 1-3 who participate in inservice sessions at 
the Renter will demonstrate con5)etency in diagr)psirig i^eading 
skills^ to^ 905^ criterion* 

The objective was expanded; therefore the target group of par- 
ticipating teachers changed each year--the first project year 
dealt with teaphers of grades one through three; the second pro- 
ject year with teachers of grades four through six; and the third 
project year wit)i teachers of grades seven and eight* The statis 
tical design for the secondhand third years was changed from, 90% 
competency "to^ a mean gain significant at the S%Jlevel. , " 

Evaluation First Year - 1971-72. 

An analysis of the' results are ,as follows:^ Of the- 12 teachers 
taking the test# only teWher 9 achieved the 90^ competency level 
of performance criterion established^ for this objective. The 
other teachSrs scored in the following patterns:, teacher 1 — 87%; 
'tbachers 2, 5, 7,^ apa '8 ^scored in the 70^. range; teachers i|, 10 
and* 12 . scored in the 60J^^range; t^eachers 3* 6 and aII scored in 
the $0% r^inge, - The mean spore of the group wa§ SB. "Why didtjH 
the majority of tei^achers achieve 9Q% competency in diagnosirig 
oral reading problems?" SeV^eral factors seem related to this 
question! Pir^t, mastery of the symbols that teachers used-'fa?* 
recording the oral reading errors took longer than expected. 
Second, using the diagnostic instrument requires considerable 
practice-^- -perhaps .a shorjb-coming of our inservice program. This 
became evident whe^i the Paderborn srbaff attempted to record the 
errors and found additional eirors with each playback of the 
videotape. Third, the teachers had more difficulty recording 
the types of' errors than they did in identifying them.. The 
most difficulty they had was in recording the pomprehensi6n 
questions accuratelv. Although they were able, to record these 
questions wi.th 91^ accuracy,* forty percent Of their responses , 
were incorrect^ This pulled the group scoj^t^own ^ to $1% {91-UO) 
accuracy in identify^^ 6r&i reading errors, accuracy in 
identifying comprehenaion errors, and 6l^% accura^ft5^ in recording 
oral reading errors. The teachers* lowest scores were in re- 
cording errors. " 9" \ ' * 
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Teacher Oblgct-lve One Second Year --.1972-73*. , . . . 

Teachers in grades four) five and six, who participate in in- 
service training sessions at the 'Center will show significant 
gains at the 55rievel .in the ability to diagnose reading beliavior. 

Evaluation - Second Year - 1972-73 • ^ 

The score which wa3 used in the evaluation of this objective was 
based on the diagnostic evaluation of three passages containing 
a total of 18 decisions by the participating teachers* Hie mean 
cain. score was 2*11, despite an observed negative^ gain of -6* 
Of^ the 18 teachers for vrtiom^both pretest and post^test scores 
ware available, all but i+ showed improvemen\,djiring the period 
of the experiment, and onlylone failed to do as well on 'the post- 
test as on the pretests Thp t-value for the mean gain score 
was found to be 3.2^, whitsh is significant at the .01 level with 
17 degrees of freedom. 

The observed imp"rovement in. diagnostic skills (p .01) can be 
interpreted as laeeting or exceeding the stated objective which 
sought differences significant at the .05 level. This improve- 
ment in diagnostic ability is perhaps less significant in its. 
halving me"t this objective than in the demonstration of the re- 
lationship between adequate diagnostic skills and an effective 
program in. reading improvement. It is also important^ that the 
overall difference was found to be significant, since it. is not 
unusual in such experiments for a small' number of participants 
who sho>; no improvement to\ depress the modal performance of the 
group. In spite of several such cases, the findings reveal that ' 
the objectivg-Tref^ satisfactorily met. 



Teachei^ Objective One - Third Year - 1973-'lU« 

A. Teachers in grades 7-6 who parti/iiuate in inaervice . 
sessions at the Center will show significant gains at the 

-level in the ability to diagnose readirfe behavior. , , 

B. Video tdpe will be utilized as a pre-post evaluation 
instrument.. .. ' 

I- ' * 

Evaluation - Third Year - 1973-74 • 

The. video tapes which were utili'zed in e.valuating this objective 
were commercial tapes designed to measure diagnostic skills, Die 
» tfommon «nav^r sheet introduced during the second year of the 
project was again employed this year. iSince the relevance of 
attaining skill iu the diagnoses of reading errors is dependent 
upon the proper remedial recommendation (Teacher Objective III) 
both Of these evaluations were completed at the same time. 



Hxe score used in tkp evaluation of this objective was based 
on the dia^ostic evaluation of three passages containing a total 
of 18 decisions by th.e^ participating teachers* The three passages 
were presented on a pretejgt-posttest basis^# 

Table 1 summarizes «th8 rosvilts of the evaluation of Objective I# 
All of the 3i± teachers from grades 7-8 on wjiich complete data 
was available made positive gains in error diagnosis with a mean 
gain of 2*33. The t-value for this mean gaip was U.66, which 
is significant beyond tfcte •Ol level. o 



Table 1 

Tests of Significance on the Videotape Tests 
•for Teacher Objective^ I and II 



' , Subtest N Pretest Posttest Mean S«E# t 

Mean Mean Gain 



Error Diagnosis 11.67 14*00 2.33 -50 U.66^w 

.Remediation 8.67 11*00 2.33 1-36 1.71 

Techniques 



. -JHfr p<.01 



The Qfbserved mean gain in diagnostic skill (p .01) cap be in- 
terpreted as exceeding the stated objective which sought dif- 
ferences significant at the .05 level.- Although the sample size 
was quite small (five other teachers participated but did not 
take the posttest), eaoh of the six teachers did exhibit improve 
ment in diagnostic skill. 
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Teacher Ob.1 active Two First Year -- ir971-72-. 

Teachers in grades 1-3 will Ctemonstrate competency to group 
students homogeneously for instruction in relation.rto skill 
deficiencies to 90^ performance criterion. 



Evaluation - First Year - 1971-72. 

A -breakdown of the results shows t- Of the 17 primary teachers 
who performed on this teat, achieved the. 90% competence 
level established for th>s objective. The others achieved in 
the following manner: 12^ scored in the 75^ range, 12% in the 
65^ range and 29??^ of the scores fell below the 65% rajige. The 
mean percentage for the 17 scores was ^ ■ 

A T^iew of the resultaHbllustrates that a- sWi3t^t)ial number 
of teachers (8 of 17) achieved or exceeded the cotopetency 
criterion. , ' - ' 




Teacher Objective Two Second Year 1972-73. 

Teachers in grades foiir, fiv^and six will demonstrate competency 
^■\to classify students for instruction in relation to --skill de- 
ficiencies. 




Evaluation - Second Year .- 1972-73. 

Results of the- evaluation' by interpreting data: 

Jt is somewhat difficult to evaluate the success in meeting this 
objective due to several factors. First is the ot)nfusing r»ture 
of the directions. . If 7 of the 21+ were so thoroughly confiised 
as to. invalidate- their responses, it is, not u^easonable to a^ssume 
some lowering of the efficiency in those whose responses were 
retained. Secondly, there is some problem in the criterion used 
as a key, since the classification by the reading specialists 
might be in error — or at least no more correct than the groupings 
done by classroom teachers. Thirdly, hierarchial ratings may 
or may not be the best method of assigning students to remedial- 
groups. In spite of these difficulties, 1+ teachers grouped the 
'students in agreement with the experts in 95% or raocre- of tiie 
cases. It is' worthy of note, tfiat in Hiany instances, the students 
who vere misclasaif ied were placed in groups consistent with 
their i^eading' ^eeds, but -not in' the group preferred by the ex- 
perts. Because of this basic agreement on the nee'ds of the 
■ students, it is felt that this objective was satisfactorily met, 
'although the method of assessing.it falls short of satisfaction. 
The inability to statistically evaluate this objective indicated 
termination* Therefore this objective was unattainable. . 

This objective was terminated after two ye'ars because the pb^ 
iective did not provide for a valid statistical design. The / 

16. ^ 



ability of a t/eacher to diagndse and classify student reading 
behavior in agreement with 'the diagnosis and classification of 
the reading eatpert did n6t verify that the teachej^ had become 
competent. The basic goal of the objective was -ambitious but 
the development of the acceptable , statistical design to measure 
attainment of the objective could not be accomplxshed for the 
final year of tl^e progrsm. 



Teacher ObUctive Three First Year 1971-72. 

Teachers, g^rades 1-3, will demonstrate increased competency in 
selecting appropriate materials fpr development of specific 
skills. ' \ 

Evaluation - First Year - 1971-72. ♦ , 

On a pre/post test design administered in January and March, 
teachers w«e asked to list the number of materials that would 
teach specific skills. The same instrument was used, -as the pre/ 
post measure.-- Mean scores were computed. The teachers re- 
aponses were recorded on a cor.rect/incorrect basis. The results 
are as follows: The group mean for correct responses on the 
pretest was x = 9. The posttest score was x = 13.4. The gro^P 
mean for incorrect responses on the pretest was 3j - 5.o. The 
posttest score was x = 6.0. The correct responses category, 
teachers grew «in .their selection of appropriate mateijials 
to teach specif icjskills , but they also increased their in- 
correct responses by However, this increase was minimal 
compared to their increase in correct responses. 

2 

The results indicate that primary teachers have made substantial 
gain in their ability to select materials used at\^e Paderborn 
Center, to teach specific language ai!(£^-vj;:eading ski%;Ls. 

Teacher Objective Three Second Year -- 1972-73. 

Teachers in gra'des four, five..and six, w^l demonstrate in- 
creased ability to' prescribe appropriate m&terials for develop- 
ment cyf specific reading behavior, . \ 

Evaluation - Second Year - .1972-73» 

Table 2 

Tests of Significance on the Viddo Tape Tests for 
Teacher Objectives lT&.nd 



Pretest Posttest Moan Gain 
Subtest N Mean Mean P ost-Pre S,E, - t;. 

Error Diagnosis l8. -9.89 12.,00 2.11 .65 3.25^ 
Remediation 8.78 10.61 I.83 .72 2.11 
Techniques . — ■ 

* p .05 : • 

As can be seen, the mean gain score was r.83 knd its associated 
t-ratio wis 2,11 which is significant -at the .05 level with 17, 
degrees of freedom. . ^ 
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Results of the evaluation by interpreting data: 
.The sdme video tapes which were described in the evaluation of 
Teacher Objective 1 (Diagnosis of Reading Errors) were utilized 
in the assessment of success in fulfilling this objective. Ihe'^ 
result of this procedure added relevance to the experience oC^ 
diagnosing deficiencies and prescribing appropriate remedial 
materials to promote progress in reading, in that, it made the 
evaluation task very, much like the actual demands of working 
with real students. There are, however, some shortcomings in 
employing this approach Irf^tesfingoBjectives, since the person - 
making the recoramendation^ must first identify and classify the 
deficiency before prescribing appropriate materials for the 
development of > specific reading behavior. If the diagnosis is 
in error, th§^ materials prescribed for remediation will also be 
inappropriate, and therefore, scored as incorrect. Pindfng a 
significant improvement on, this objective is then dependent 
upon successfully filfilling Objective I. 

Higher gain scores and greater improvemant dould perhaps have 
been achieved by asking the participants to identify appropriate 
remedial materials tp compensate for a list of reading deficien- 
cies. However, in defense of the technique employed, the added 
realism of the combined diagnostic-prescriptive task was felt 
to outweigh the merits of achieving higher scores or greater ob- 
served differences in a more artificial format.^ Nevertheless, 
the results were found to be stalJistically significant at the - 
.05 level, and therefore .it may be concluded that the objective 
was .successfully met . ^ ' 



/ 



Teacher Objective Three Third Year 1973-7U. 

N<rte: This objective was identified as Teacher Objective II 
" for the 1973-71+ .school year but it should have been 
identified aa Teacher Objective Three. The problem 
was caused by the termination of Teacher Ob j.ep^tive ' Two. 
Ana^ther objective was added and should have replaced 
the terminated objective. Unfortunately in the con- 
tinuation report, objectives three, four and five 
were elevated one podtion and a new objective was 
^ introduced as Teacher Objective Pive-1973-7U* 

correct order is maintained in this report. 

Teachers grades 7-^ will demonstrate increased ability to pre- 
scribe appropriate materials for development of specific reading 
behavior. . 

B. . ^ f 

^ideo tape pre atid post. 



ERIC 
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Evaluation - Third Year - 1973-71; • 



Table 1 page 3 which was previously presented under Teacher Ob- 
jective I also reports the findings under Objective III. Sub- 
.sequent to their diagnosis of reading errors^in the video tapes, 
the six teachers were asked to identify the appropriate remed- 
iation techniques • As can be seen in the table, the mean gairj 
was 2.33 from pretest to posttest. However, the t-value of 1*71 
for this mean gain fell short of significance at the .05 lev.el* 

Although the mean gain. was non-signific4nt , the fact that 
overall improvement on remediation was *o*bserved is by itself, 
quite important. Several plausible explanations exist for the 
failure' to achieve statistical significance. First, the skimpy 
sample size in this case certainly lowers the power of the statis 
tical test.^ Secondly, a teacher making a rexjommendation must 
first identify and classify the deficiency before prescribing 
proper remediation techniques. If the diagnosis is in error, the 
method prescribed for remediation will^ also be inappropriate, 
hence, scoi^ed as incorrect. Thus, a hagh score under remediation 
is somewhat dependent upon a high diagnostic score. However, the 
realism of this combined diagnostic-pjescriptive evaluation for- 
mat was felt to outweigh the merits of achieving artificial 
independence between the two tasks. In any event. Objective III 
at best was marginally satisfied. ' • 



Teacher -Objective Four Pirsi Year 1*971-72 • 



Teache 
evalua 



rs will increase competertcy^in developin^appropriate 
tion (questionfpg) devices for reading cpmprehension. 



Evaluation - Pirsi; Year - 1971^72. 



I 



Each Fade rbofn staff membpr evaluated the results of the primary 
teachers' vritten questions. Then the results were compared and 
a corL3«nsus opinion' determined..whether the questions were literal, 
interpretive, or isvaluative. 

The- majority of questions,^ asked on the. pre-tests were of the 
literal type;'' Second, ca:me the ev^iluative type, with inter- 
pretive questions being the least *asked, " A , percentage breakdown 
would indicate the following: Literal 69%, Interpretive ^13^, , 
Evaluative l8^. The posttest resultis show a drastic change in 
the types of questions asked by the primary teacfiers. The great- 
est change occurred between the literal an^ interpretive type 
questions, Dr.^ Rictiardson/ reading consultant, S.I.U. Edwards- . 
ville, stressed the importance of asking more interpretive and 
fewer lite^-al ty^e questions ^nd lifted the following criteria:. 
LitexAl 10%, Inte^f^etive. 80^ and Evaluative 10%. -The teachers _ 
responded by inci^e^sing their interpyetiVe. typB 'questions fr'bm " 
13^ to S3% ana decreasing their: literal typp |*rom^ 69^' to' 12-^. ' - 
-The teachersr increa3ed their evaluative questions from l8^ to 3^%. 
' Although*^ the' teachers^ 4id *not .reach the criteria set by Dir. 
Richardson, they did make substantial gains In their ability to 
ask high level reading-thinking questions. ^ ' , , 

^ ■1 ^ ■ , ■ ; - ■ ; 

. Teacher Objective Four »- Second Y^ar — a.972-73» 

Teachers grades J4.-6 will increase , cdmpetenpy in developing ^ 
appl^opriate evaluation (questioning) devices fqr reading com- . 
prehension. , , . ' . \ 



Evalua tiog- Second Year-1972-7«3. * ' 

, ■ ..^^^^ 

^n the ,pretest administered in September, the percentage^ of 
questions falling into each category were Literal 63^> - Inter- 
pret ive'^'22^ arid Evaluratiye, tS%^ 

The posttest, administered in February to the same teachejt?s, 
resulted in the following percentagets ;^ Literal-3Q^^ Interpre- 
tiver39^, Evaluativer32^^ • • . , * 

The improvement was measured stati6ticalXy ^by testing the mean 
gain in the proportion af higher-level (interpretive^ and eval- 
uative) questions. The data were scopes 'from the 22 teacher^'for 



whim -fco-th' pre! and postte^t scores were avdlabj©.'. The t-value • 
of such a test was found to be .6.i|8» which is significant at the 
.01 lev^l (p .01) for 21 degrees of freedom. Table 3 aummarizes 
16 se findings. ' • 



■ Table 3 

Tefet of Significance on Pr6portion of Interpretive and 
^al.uative Questions for Teacher Objective IV 



P:tetest Posttesl? 
N Maan Proportion Mean Proportion 



Mean Gain 

in Proportion SE t 



22 



.37 



.71 



.31+ ' ' .05; 6.1^8** 



4Ht- p .01 



Resvatalof the evaluation by interpreting data: 
The statistical analysis indicates that the teachers were quite 
successful in increasing their competency in devel^oping approp- 
riate e^ialuation devices for reading comprehension. ' > 



Teacher Obtlective ^'our — Third Year 1973-7i|. ' 

A. Teachers graces 7-8 will increase competency in developing 
appropriate evaluation (questioning) devices for reading com- 
prehension. ' 



B, . The 



iestywill be developed by the Center's staff. 



Nctn-. tm ^q/-^^^?^■^/^v^ M»-'v-ldent±fi^ d ad Teacher Objecti ve' gree 
f^ir^the 1973-714. school -ye^r. It should have beetr^cteTp- 




■;ion-Third Ye.ar-r973-7i|. . 



stiijns 



tified as Teacher. Objective Pour. See page 7 for-ex'*' 
pranition. ' < * 



pretest administered in September/ the percentages of 
fallihg into each' category are depicted %elow: -. 



' '^INiERPSBTSVE 



-r- EVAliUATIVE 



The postteat administered in Marclj to the same teachers resulted 
in the following percentage.s: 



•->. 



• jllTERAL ' ...INTERPRETIVE . EVALUATIVE ^ 



The -above improvement was analyzed statistically by testing the 
main gain, in the percentage of higher level -questions (inter- 
pretive, and' evaluative ) . The data were scores from the seven 
teachers €ov .whom both pre and posttest scores were available. 
The mean .Fierce ntage gain in higher level questions was 15%, 
which fell short of statistical, significance . ^- Ta^ble i| summarizes 
this analysis. . ■ . " 



Table 4 



Test of Significance on Percentage of "Interpretive and 
Evaluative. Qiiestiona for Teacher Objective IV 







Pretest , 
Mean Percentage 


;• Pos-ttest 
Mean Percentage 


Mean 

■ Gai;g 




7 


^/ ..51%- 

if"' ' 




- 15^ 


ej^ 1.88 



, This objVbtive was^TffsrtitTaJ^^ graphical 
evidelnce, the . teachers did shift moderately toTTigher-leyel — 
questions on the posttest • However, these gains were;^ not 
sufficiently pronoiJinced to attain statistical aignif ioadce^* 



Teacher Objective Five First Year —1971-72. . * \ 

Teachers, grades 1-3, will increase i;i content kpowledge about - 
language arts-reading processes. ^ 

Evaluation/ - First Year 1971-72. , 

Procedure: the primary teachers pre/post tes^ scores were cotn^ 
pared by using the hypothesis ; Un=0. A mathemat^Lcal formula 
was used to determine the statistical significance of the results. 
A few teachers either forgot their number or did not take the 
pretest because they were new to the districts or from^ parochial 
schools. These teacher's were assigned the pre^roup me ah scQr^ 
of 28 in order to use all 17 scores for comparison purposes. 
•The, table below lists the results: 

» <t 

Table 5 



Mean Difference 



28.4 



Standard. Deviation 
of Difference 

6.6 



t t(N-17) 
17.7 '.001 



^ ' 

The Jjrimary teachers from the participating schools, as ^a group, 
made significant progress in their content knowledge of the 
language arts reading processes. This growth seems related to 
their participation to the, inservice activities of the. Paderborn 
Project since, all these activities were designed to improve • 
teacher knowledge of , their important* skills. 



Teacher Objective ^Five — .Second Year 1972-73* ' ' ^ 

* 

Teachej?s will increase content knowledge about the language 
arts and reading process. ^ , - 

'Note: The' evaluators ^and the project director determined 
~ — -^^hajb^the statistical design for this objective 'wa3 ' 

redundant in, that it was actually a composite eval- 
uation of the previous objectives; therefore, for the 
remaining ^i»oject years^tnis objective provided a . * 
• ••• summary evaluation. - 



12 

24 



EviiluattoD -' Second Year - 19J2-73. ^ r 

discuaoing the achievement of this objective, the results 
repoi«ted on the previous four objecWw leaves little, doubt as 
to the successful attainment of pi^omolilhg increased content 
knowledge about the language arts readirig pi^oceas^a in par- 
tifcipating teachers. /Since pretest and poi3ttest comparisons were 
utilised in Objective I, III, and IV, and significant gains were 
observed in all cases, each conclusion stated for those objectives 
Is supportive o£ success in meeting Objective V. The s trees ,pti ^ ' 
simulating actual experiences in the assessment of diagnosing • 
reading skills (Objective I), and prescribing remedial tasks 
(Objective III) adds to the relevance of this objective to . 
actual practices. Significant improvement was also o^?®^!! Ttr\ 
the level of questioning developed by the teachers (Objective iv;, 
and although the setting fbr this test was more artificial, the ,5 
classroom teacher often develops evaluative B|aterial (questions; 
outside the classroom setting. Although a«pre and po.stttesx 
format was not used on Objective II,. the success of -some teachers 
in grouf)ing students for instruction in light of skill deficien- 
cies supports a terminal skill in this area as well. 

In terms of future efforts, added attention iiilgl^t be given to an 
• Improved level of performance in ^ach of the area|^. Although • 
there is no 'que-stion about the success in meeting the objectives 
so far as finding significantly improved levels of skill- in the 
areas conceited, it is desirable that the teachers make as many 
correct diagnoses as possible. While it would be unsatisfactory" 
for a classroom teacher to correctly diagnose only about of 
the readirig problems of the student, it should b^ remembered 
that in the actual school setting, the tecJpher is not limited_^'^ . 
to the^' restricted behavioral sample . which practical considerations 
make mandato^ry In data collection for a project such as this. In 
terms of observations made from a single episode, the levels of 
skill presented by the teacher* "posttest performances might hb^ ^ 
quite acceptable . n 



Vtam^ry, the final objective seems to have been satisfactorily 
by the participating teachers' improved performances at the 



In s 
met 

end of the present project year 



Teacher Objective Five. — Ohird-Year 1973-7U« . 

A. Teachers will increase in content knowledge about language ' 
arts-reading process. 

B. Evaluation devices will be designed to evaluate knowledge, 
skills, and applications- gained on each , in service topic. Eval- 
uation of Objectives One, Two, Three will provide baseline data,. 



Note: 



object!^ was identified as Wacher Objec^^ve IV 
the 1973-71i achool year. It should haVe been 
identified as Teacher Objective V. See page 7 ^ 
for explanation . ' . ' 



4> 



ralu'a^iioB - Third Year - 19J3-7U. 

Since this is a summary objective, the' results prevl/ously pre- 
sented vnder . objectives. 'I-III should be revlewe^^. The tables and 
graphs will not be repeated in this section. 

fretesp and' post tife'st comparisons were utilised in each of jbhe 
Objectives I-UI and IV.* In each or these Analyses, teachfer irft- 
provemeat wds exhibited, but-only in the case of error diagnoses 
was the galh statSStically significant. Since the sample sizes 
were extremely smaKL (6 for Objective s-l and. II and 7 for Objective 
IV), the .failure- to achieve significance ia^npt as damaging to 
the fulfillment of these objelctives as Hould be the cas^ witl^ ^ 
large*, samples. particularly noteworthy that on the 12* 

pretest-pdsttest difference S|,obflkined for the si£ teachers 
under error diagnosis and remediatioln^, combined, only ^ne dif- 
ference resulted ih^ a -negative gain. Also worthy of mention is 
the fact that under Objective III, ^e seven teachers increased 
their productivity of the highest level questions (evaluative) 
by. $jp avei^e of l8% (See graph). 



In summary, conisidering t|ie size of the "samples involved. 
Objectives I-III and JV were marginally satisfied. 
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Teacher Objective' Six Third Year 1.973-7I|. 

A sequential treading curriculun> wj^itten in (Objective fom, thaV 

provides the learner with the opportunity to utilize alternate 

styles of. learning to read and provides the teacher with the 

opportunity to iaatd|pval7ied types of educational materials and 

equipment to the learners* individual styles, will be develoiJbd 

for utilization of the seven cooperatitig school districts. The" 

curriculum will be completed by April 7 , 197it» 

* 

No,te: This objective was classified as Teacher Objective 

Five for the 1973-7i+ schoql year but should have been, 
identified as Teacher Objective Six. See page 7 
for e;q)lanaTO.on. 

Evaluation - Third Ypar - 197.3-71+. 

Sequential reading curriculumA^ritten in objective form was 
developed by- April 7, 1971+ and reproduced by April- 30, 1971+ 
and distributed to all teacher participants May 2l+, r97l+. A 
survey of .the te^ers indicates that 60% intend to utilize the 
c\irricul\am as an aid for planning their instructional reading 
program. • 



V 
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student Objective One First- Year — 1971-72. 

The individual student will increase feis compe^ten'd^ in l^eadingi 



Evaluation - First Year - 1971-72. . 

The two ma lor .elements of the program are to be measxared by changes 
in individual student performance .^^ — The two treatment groups are 
named Experimental I and Experimental II. The treatments are as 
follows: • . ' ♦ 

Experimental Group I: A pool of students (Group A) was selected 
from the cooperating districts using Wilson ^s Criteria. Of this 
pool, 39 were assigned for individualized treatment at the Center. 
A second group (Group B) was randomly selected from second and third 
grade students in the district scoring, in second gra<jle, between 
1.6 'and 2.0 (grade equivalent), or at stanine ij. in third grade. 
Theap* students received their reading instruction at the Center by 
the 'Center professional staff. 

Experimental Group II: After the pool of" students was defined 
using Wilson's Criteria, and 39 (Group A) were ra^omly assigned to 
the Center, "the remainder were included in Experimental Group II. 
The remainder (Group B) of Experimental Group II consisted of ran- 
domly chosen students from grades two and three as described for 
Experimental Group I. The treatment for Experimental Group II con- 
^sisted of instruction by the regtilar classroom ^teachers, all of whom 
were involv.ed in the inservice activities afe the Center. Rie ul- 
timate goal of the' inservice activities^vas to bring about .changes in 
the students taught by the affected ^>eachers^ 

Some 'students in both Experimental Gro^p I ^nd Experimental 
Group^ il were lo.st from the sample becaij^e ^hey moved frc^'the 
district, were abseiat-^ip-ing the tes^tiSg^he'dule or were withdrawn 
from the program. As af result th^ Sample size of both Experimental 
groups is smaller. f 

The Gates-MacGinitiB, Reading^s Test^ Gates MacGinitie Primary 
A, and. Stanford Diagnostic Re~^aa|tng^Tests were used as the measures 
in the respective groups. Forms 1 and 2 (Primary A) of the Gates 
were used for grade fkfo. / Based cin data prese^e4 (5n page 8 of the 
technical manual accompanying this test, the 
measurement for the- Vocabulary section is J*7 
hension section is 2.5» 



tattd.ard error of 
and for the Gompre- 



The gains of each pupil are reiported in Standard Error of 
Measur'ement\ units. 

^ A confidence interval of. 90^. is established. That i% if the 
gain by ihe^ student would hav« occurred less than 10^ of the time 
by chance aione, the assumptioj|J|||^ made that the student has made 
a "real^' gain.. A 90jS!:^vconfiden^^interval (under the usual assumption^ 
of noirmality) translates to a change of 1.26 standard ^^rroj 
^us the tables reflect the probability of the^^^shange'"'Tfnstudent 
performknce by chance alone. ^ 
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Results of the evaluation by interpreting dataJ • 

Reeults from Sxperlmental Group I -A -^-Second- firadaj On VocaD- 
ulary, H of the l^^students (79^) made significant gains', and in 
comprehension the figure Is 10 of Ik {71%), Five students- ( 3, 4, 
6, 10 and 12) did not raajce significant gains«in at least one. of the 
two sub-tested ^eas. -* • ' 

• Results from Experimental Group .Zf^--Second 'Grade: (n=io) 
Of these, 9 o^ 10 (W) made signl^cant gains. , Only student No. 8 
fell short of a .6igni^i«ant ga|^7 and this only -in comprehension. 

- For studeu^^''^r^:?q?eiNimental I and II at Grade 3, the Stanford . 
Diagnostic Rejt^ng Te3\ (LAvel I) was used in a pre/post design 
(Forms W and^) . BasedNjn/data given in the Teachers manualf or • 
these tesl^ (page 29), the standard error of measurement and^eliabilr 
ity coer-fici^ are: SEM= 1.7 ' ■ ■ 

Reliability^ 95 

Using the same confidence leve^ used for Grade 2 (90^) here is 
a breakdown of the gains for- the Experimental I and II Group A 
thi rd grad^ -students. 

Results from Experimental Group I-A-Third Grade ; Indicates 
that 8l^ (17 of. 21) made substantial progress in reading achievement. 
Of these, all 17 students scored below the .01 level of signfioance . • 

Results from Experimental Group II-A-Third Grade: Sixty per- 
-cent (9 q£J.5J of the^students have made significant gains, seven ' ^ 
achieved below the .01 level of ?ignificance. Qf the six students . 
who failed to make significant gains in reading achievement, i; 
had lowe^. raw scores (-) on the posttest 'than on the pretest. 

Results from Experimental Group I-B-Second Grade : 56^ (9 of 16) 
of the students made substantial improvement in reading. A further 
analysis showed that 88jS (Ik of 16) made significant progress in 
vocabulary and 63J2^ (10 of 16) made progress in comprehension. -Five 
of .these students scored below the .01 level of significance. 

Results from Exp'erimental Group II-B-Second Grade : 75^ (9 of 12) 
achievdd significant reading growth., 92% (11 of 12; showed sub- 
stantial progress in vocabulary a*d 67^ (8 of 12) made progress in 
comprehension. 67J^ "(6 of 9) of these scores fell below the .01 
level of significance. 

^ Results from, Experimental Group I-B- Third Grade ; 75^ (12 of 16) 
of the students made substantial improvement. Of thes"e, 83% 
(10 of 12) were below the .dl level of significance. 

Results from Experimental Group II-B-ThiTd Grade ; 75^ (13 of 17) 
of the students made significant progress. One hundred percent of 
their scores fell below the .01 level of significance; 
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statistical Svanmary: ' . , „ ^ ^ 

605^ of the total number •from the se&ond grade Group A and B atudenta 
attending tbs Paderborn Center made significant progress in both 
vocabulary an^ comprehensioa<\ 83> showed progress in vocabulary and 
67% showed progress in comprehe^ion from the-se groups.^ 

62% of the students from the regolaf second grade classes in Groups 
A and B showed substantial growth, in reading achievement, 96% 
achieved significant progress in vocabulary and 78% showed progress 
in comprehension. { ^ ^ 

Of the toal number of third grade students attending the Paderborn 
Center from Groups A and B, "785^ made' substantial progress in reading 
comprehension. Also, 6Q%'jot the third grade studeja-ts from the 
regular classroom Group A ahd 'B showefd signific^t improvement. 




^Student Objective One — Second Year — 1972-73« 
Students, grades will increase^their competency in Reading. 

Proposed Propedures and Activities: 

Prom each gra^e level 4» 5 and 6 in public and private schools, 
sixty , students' shall be identified by teacher recommendations and 
by applying Wilson's criteria to scores derived on the Stanford 
n^ ngnnat-.-tr Tftflt . Twenty-five students from each grade level snail 
be selected for Center attendance and thirty students shall be 
identified , for individual classroom programs. The Centbr students- 
will be classified as "Expsrimentfiil Group I and the classroom 
students will be classified as Experimental Group II. A control 
gro-up wirii" be established at a school that is not participating in 
the project. The same salection as utilized in identifying Experi- 
mental Group I^and II will be utiMzed. The control group will n6t 
receive any of the Center's prograln treatment, Experimenta.1 Group 
I will receive two half days a week of instruction at the Center. 
Hie instruction shall, utilize team^'^cro-teaching, individualized 
instruction as instructional stratagies in conjunction with a 
Learning Center* Experimental Qrovsp II will have their prbgram 
planned by the Center specialist in conjunction with their clisaroom 
teacher. The Center specialist Will spend a i^inimum of one half 
hour per week working with each classroom teacher involved in 
the project. .'■>'■ • ' 

Proposed Evaluation: ' " • 

Establish Experimental Group I and II. Establish the control group. 
The gain scores of Experimental Group I and II will be comp^ed t(3 
the gain" scores of the control group. Gain scores to be determined 
by the Stanford Diagnostic Reading Test administer iad in Septeiaber 
as a po'sttesfc. — A VU^fe' conl'idence A.ntel»Val for each individual 
student will b^e. utilized. It is them possible to say that any 
student moving 1.28 standard error units has gained in a non-random 
manner.. " <>. ■■ • . 
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A control group will be establisliod' at a school that is not par- 
ticipating In the" project. The same selectioryas utilized in 
identifying Experimental Group I and II will /be utilized. The . 
control group will not receive any of the Outer's program treatment. 
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Evaluation - Second Year - 1972-73* 

The evaluation of the. group performances on Objective I was pursiied 
by e^oying the statistical technique of analysis of covariance . 
(AN0C0VA4.. This procedure is appropriate because it removes all 
variation in the posttest scores that can be accounted f^» by 
differences in the pretest scores. Essentially, A^IOCOVA yields 
adjusted posttest means for the treatment groups which actually 
Beppeaent what the posttest meang would have been had all the pretest 
mfeans been equal. Differences in adjusted posttest means then 
be 'tested for significance. 

■ Tables 6 - 13 represent a summary of the group performances of 
grades k, 5, and 6 on Objective I. Although not shown in the ^ 
tables, f^r each ANOCOVA, ^preliminary test of homogeneity of • 
regression coefficients .was carried out to ascertain whether the 
slope of the regression line within each group was the, same.. In 
&11 cases, the P-ratio was non-significant and the assumption was 

/supported. Thua, the main analyses were ' conducted. ; 

As can be seen in Tables 6 and 7 the ANOCOVA on the ]+tl» grade S^RT 
comprehension -scores was' nonsignificant.. . This implies '^'^^^ yf 
adjusted posttest means for the three tree||ent groups did nbt differ 
signif-icantly even thourtK each group made fHQe rate gains in mean . 
grade equivalent scores/from pre to posttest. Thus, neither 
Experimental" Group I Tstudents who attended the Paderborn Center; 
nor Experimental Group II (students who rec^ved reading assistance 
in their regular schools from teachers served by the Paderborn Cen- 
ter) showed significantly greater gains than students in the 
conjtrol groi:p (students in a school ^outside the distric.t ^ffe^ed^ 
by the** Padei'lj.orn Center.) • ^ 

Table 6 

Grade Equivalent Means for Grade \\ on the SDRT Test 
for. Student Objective I 




Groups 



N 



Pretest ' Posttest , Adjusted Posttest 
Me an y Mean \ MG*an_ 



Exp. II 21 ' 2.U8 

Exp. I 23 ' 2.33 

Control (N.-A.) 10 2.U14- 



3.28 
2i96 
3.27 



T 



3.21 

.-3.0U- 
3.2U 



Table 7 

AN0C6VA- Summary on'^ the Grade i|.SDRT Grade Equivalent 
Scores for Student Objective I 



Sources ■ ss . 

Groups (adj.) ~.U3 2 .22 
.Within Grou ps (adj.) 17.58 50 «35 

Total (adj.) \\ , 18.01 52 



Tables 8-10 summarize the performance of 5tb. gr^de students on 
Objective I. Table 9*indicae&s that the F-ratio was significant 
at the .01 l«vel and thus differences among "the adjusted posttest 
means for the three groups (Experimental I, Experimental II, and 
Control) may be inferred. The, subsequent follow-up tests in 
Table 10 identified a' significant difference befWeen Experimental 

• Group II and ijie Control Group ( =.0l) in favor of the former, but 
no significant difference between Experimental Groups I and II or 
between Experimental Grovfp I and the. Control. The finding supports 
the philosophy upon which the Paderborn project was Initiated, in 
that the availability of a resource center for teachers would re- 
sult in large improvements in student j?eading achievement v/ithout the 
ne-C.e.asjLty of bringing the students to the center itself. WhiDe a 
significant difference was not found between Experimental Group"! 
and the Control Group, the observed difference in favor of Exper- 
imental " I was in the exbected, direction. Finally, it should be • 

pointed out from Table 8 that both experimental groups increased 
their mean grade equivalents from late grade 2 on the pretest to- 
early to middle grade i^on the ^posttest. Thi's, in itself, is quite 

• an accomplishment, , / ' 



Table Q _^ . . 

o ^ - 

Grade Equivalent Means for Grade 5 on' the SDRT Test 
for Student Objective I 

Pretest Posttest Adjusted Posttest" 

-Me an Mean Mean 

2.92 ' 4.60 1+753 

■■2.72 ' U.IO if. 16 

2.88 3.6U - 3.59 



Groups \ N_ 



Exp. II 22 
Exp. I . 29 

Control (N.A.) 8 




Table 9 



ANOCOVA Sximmary" on the Grade 5 SDRT Grade Equivalent 
Scores for Student Objective I 

Scourcea as df ms P 

Groups (adj.) * 5-38 2 2.69 5.09** 

Within Groups (adj.) 29.09 ; 55 .53 



1 



Total (adj.) 3l|.U7,f 57 

•JW p <.01 



Follow -Up lests on 



10 



5 Adjusted Me^ans for Student 
Objective I 




Comparlaori 



Exp^ II vs. Exp. 1 
Exp. II vs. Control' 
Exp. I vs. Control 



Difference in- Adjusted 
.Posttest Means 



pC.Ol 



.37 
.% 
.57 



S «£ i 



.21 
.-'30 
.29 



1.76 



Tables 11 - 13 present the findings with respect to^ the 6th graders 
on ''Objective I. The findings, for 6th graders paralleled those for 
the 5th grade I with the exception that the results here were sig- 
nificant at the .05 level rather than the .6l level; The adjusted . 
post test means for the Experimental H and Control groups again 
differed significantly, but the other two comparisons were non- t 
significant Table 11 shows that in both experimental groups tlie 
student? increased their mean grade equivalents from roughly mid to 
late grade 3 on the pretest to mid to late grade \\ on the posttest*. 
These mean gains are not quits as impressive as those for the 5th 
grade.. However, the overall conclusion that can be reached is that, 
for 6th graders as well as 5th graders, substantial reading improve- 
ment can ^9 Idealized by utilising ^the i^esources of the Paderborn 
(Jenter in the actual classrooms without transporting the students 
to the Center. . 
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H&ble 11 



Grade Equivalent Means for Grade '6 on the SDRT Test 
for Student Objective I . , 



Groups 



N 



Pretest 
Mean 



Postte.st Adjusted Posttest 
Me an Mean 



Exp. II 22 
Exp. I . ,26 
Control (N.A.) 13 



3.76 
345 
3.61 



U.97 

U,36 
i|.06 



Table 12 ' ' 

ANOCOVA Summary on the Grade' 6 SDRT Grade- Equivalent 
Scores for Student Objective I 



Sources 



ss 



df 



ms 



P 



Groups (adj . ) 5*kk- 
Within groups (adj . )itl.60' 



2 
57 



2.72 
.73 



3.72^ 



Total 
* P<'.05 



•i+7.03 



39" 



Table 13 



■Pollow-Up Tests on Grade 6 Adjusted Means for Student 

Objective I' 



Comparisp»' 



Exp/' 3 
E;q/.'3 



II vs. Exp. I 
II v-3. Control 
Exp." I va. Control 



I Difference in Adjusted 
Posttest Means 



S,E. 



.25 
.30 
.29 



•1.6U 

^.73* 
l.i|l 



22 



The evaluation of individual performances on Ob:3ective I was per- 
formed by usi?ig a 90^ stati'stical confidence interval. This essen- 
tially amounts to determining whether or not each individual student 
associated with PEARC has achieved a non-random gain in readxng 
'competency that would occur by chance 'only 10% of the time or less. 
Thus, for each student in Experimental Groups I and II, the raw 
score gain from pretest to posttest was converted to standard 
error of measurement (S.E.M.) units and then compared with the 
critical value of 1.28 associated with a W confidence interval. 

Table Ik 'reports tha summary inforu^ation concerning the numbef of 
non-chance gains made by the students in Expermental Groups I and II 
for grades £-6. In contrast to the data reported on group per- 
formances, 100?^ and. 83% of the i^th graders in Experimental Groups II 
and I respectively attained significant gains in S.E.M. units. 01 
cour'se, it must be rexnembered that S.E.M. = 1.5 for the grade ^ 
norms of the S.D.^R.T. Since this value is rather small relative to 
the S.E.M. for the grades 5 and 6 norms (3»5 and 2.9, respectively),^ 
a relatively small raw score gain can result, in a non-Chance im- 
provement. In spite of this fact, these percentages of significant 
individual gains at grade do represent real gains and somewhat 
make up for the non-significant comparisons between treatments 
obtained earlier for this "grade. „The individual results were most 
•impressive at grade' 5 with 86% and 83% of the students in Experimen- 
tal Groups II and $ respectively achieving significaAt gains. This 
ia particularly noteyorthy sinco S.E.M. - 3.5 for this grade and 
thus^jn'oh -chance gdins require a large raw score gain. The results 
for grade 6 were, somewhat surprising and disappointing.. Here, only, 
73% and 65% of the students in Experime.ntal Groups II and -I respec- 
tively moved significantly beyong chance. The raal concern at 
■ grade 6 is- the alarming 'number of no gains "or losses for both^group.s 
T9% and 23% respectively). These percentages may pajJtially be - 
explained by the cumuiatiire frustration th&t an ineffective reader - 
face^ by the Mme he 'reaches the 6th/gradei - 



' Tabid 11+ - ' 

Numbefk of PLARC Studen ts Achieving Non-Chance Raw Score 
Gains In Reading Compe^^ncy for Grades 1^-6-' 
■ for. Objective I 



Grade* ( 


rroup 


N 


No . Gain 
or Loss' 


Nonsignificant 
^ Gain 


Significant 
*Gai,n 




Sxp. II 
I 


21 

23 > 


0 ( 0^) 
. 3 (13^) 


0 M) 
.i.(U^) 


21 (1005^) 
19 (• 83^) 


/Expl II 
' ^ ' ! Exp. I 


22 • 
29 


0 ( 0^) 

, 1 ( 3i) 


, U (1#) ■ 


19 (86^) 
2U ( 83^) 


• , .1 Exp. II 
° • Exp,_ I 


22 
■26 


2 ( 9^), 
.6 (23^); 


■ .■ h (18^) 
3 .(l^^) -. 


16 ( I '-ii) d 

. 17 (665^) % 



'"Reavats of 'the evaluation by .irj^terp?^ ting data*: 

The findings s'aramarized >y Tables 6rl4 9ugge3t that success *wa3 - * 
realized; in fulfilling Objective ;I. Although "some prdblem is, ' ~~ ; 
posed in accounting for the .failure to find significant differences 
among the three treatment groups lit grade ij.^ this result is >miti- 
gated by ^he high percentage of ^ndividtaals^ in the ' Experimental 
Groups that achieved non-chahoe raw 6coi»^ gains ,at this graded \ One ' 
possible explanation ;of .the former finding is that ij.th graders .are 
slower to respond to retaedial treatment! 'of any type and hence no 
^signif icant differences between mean gr^ide equivalent gains could ' 
be expected* . The greater a^justd'd* postt^st grade equivalent means 
exhibited by the 5*1^ and 6th graders linf the Experimental II groups 
endorses .|ihe concept of the PLARC Centefr. In fact, the greater 
improvefid'ent of; students in r/a^rar classes ' taught ^by the partici? 
pa ting Wachers is particularly ^ehcouraging in* view of the logistical 
prpblems* of transporting children f rom \a schdpl 'setting to aVspecial ; 



Wnter, 



student ObjfectlVg Ohe — Third Year — 1973-71+.. . ' 

/ ' ' . . • ^ ' - .i 

A. Studerfus, grades $, 6 and 7 Will increase their competency in 
reading iri^the following patterns: Using a 90% confidence level, 
i-t is possible to say that any st<udenff.4aoving 1.28 standard error . 
unit^ has gained in a non-random' manr^er . • That is, over the long 
run, a gain of 1.28 or more SEM% upits^would occur by chance only 
10% (or. less) of the'xime. . • - - ^ 

B. ^ The sain scores of the Experimental Groups I and II will be 
compared to the gain scores. of the control group. _ Gain scores atb 
to be determined by f^itc^n^P^^ T)4flgnnqhin Hftflrlln^ Tft«t adminis- 
tered in, September 1972 and March 1973 as pretests and in March' 
197i^. as (i ^osttest. 

Evaluatiin -- Third Year - i;973r7i<.-. . ' ; ' \ 

The -evaluation of the group performances on Objective I>as conducted 
thtoligh the statistical technique of. analysis of covariance (ANOCOVA) 
' This te'cHhique is essentially a combination of regression analysis 
and analysis of variance. The procedure ^Ids adjusted posttest \ 
means' for the treatment groups which o^ctually represent what the 
posttest means would, have been. had all pretest mearis been equal. 
The differences in adjus.ted posttest means ar^ then tested for 
significance thro ugh ^ an analysis qf variance. In tha analysis foi^ 
the present year, pretest scores were taken as the SDRT scotea 
^collected at the 'end of the 1972-73 project year.' Posttest scores 
were- taken as the SDRT scores collected at the end pT the current 
197*3-7U project year. . * ' * ' ^ 

Tables^l5-19 represent' a* svunmary of the group performance of glrades;^ 
5, 6 and 7 on Objective I. Although. not shown in the tables, for ^ . 
each ANOCOVA a preliminary test of homogeneity of regression 
'coeffidents was carried out 'to ascertain whether tha slope of the 
regression line within each group wgt's the sfiaae.. In all cases :the 
P-ratio was nonsignificant . and the assumption was upheld. Thus, 
^the main analysis were conducted. ^ ^ ^ ' , 



Table l5 rr 
Grade Equivalent- Means for Grade $ on the^ SDRT Test 
for Student Objective I . - • 



/ - ^ 


V 

Groups 


N 


Pretest 
Mean 


' Posttest 
Mean 


Adjusted - 
Posttest Mean 


Experimental II 
Experimental I 
Control (N,.A*) 


18 
• 17 


^ 3-2i|. 
2.98 


5.^80 


1^.36, ' . ■ 
1^.13 . 
1^.73 



Table- 16 ' ^ 
ANO CO VA* Summary on 'the Grade 5 SDRT Grade Equivalent 
Scores for Student Objective I 



Sources 



as, 



df 



ms 



Groups (adj.)' 
Within (adj.) 



1.52 
25.U8. 



2 

36 



.76 
.71 

i_ 



1...08- 



Total (adj.) 



27. DO 



.38 



^ tfable 17 ' 

* • * 

Grade Equivalent M^ans for Grade 6 on the 3DRT Test 
for Student Objective I 



. — MfiV — ■ " ^.--i- 


Groups 


N 


, Pretest. 
^Mean 


Posttest 
Mean 


Adjusted Pdii*- 
Test Mean 


Lri ( — 

Experimental II 
Experimental I 
Control (N.A.) 


19 
21 
8 


. i^.76 


5.35 
U.75 

0 


-i^.«98 
U.90 



Table l8 .; 

ANOGOVA Summary on the Grade 6 SDRT Gi^ade Equivalent 
Scores for Student Objective I 



4 



* 






— .-f^ 




Sources 

» 


ss 


df / 


ms 


.5, 


Groups (adj .) 
Within (adj.) 


1.17 ' 
39.21 


2 

hh. 


' ..58 • 
.89 


-\ .66 

T^-^: 


Total (adj.) 


'I1O.38 








— ' P— 




Table 19 • ' " 

Grade Ec^uivalent Means for Grade 7 on the SDRT Test 



for Student Objective/ 



Groups 



N 



Pretest ' Posttest Adjusted -Post-- ' 
Mean Mean Test Mean ' 



Experimental II 18 
Experimenta],' I 19 
Bontrol (%A.) 8 



5.03 



5.56 
k.79 
5^65 



5-. 13 " 

5.11. 

5.82 



^ T^ble 20 
ANOCOVA Summary on. the' Grade 7 SDRT Grade Equivalent 
Scores. for Student Objective I 



Sources 



ss 



df 



ms 



P 



Groups (adj.) 
^Within (adj.) 



3.19 
19.36 



Tc^tal (^d j-, ) ^ . ' ^2f;55. 



* P<.65 



2 



Cf^ 1.60 



ft3 



3.38 V 



• , ^ . • . . . ; r 

As ckn be seen in Tables l5 - iS,* "the 'AHOCOVA' s on the 5,th and 
6tii. grade SDRT compyeheiision scoree_ y^re nonsigniTieant. T6is im- 
plies that the adjusted posttest means "ff or the three treatment 
groups at each of these gmde*. levels did not differ significantly 
even though each group mad^gaoderate gains in mean grade equivalent 
scores. Thus, in grades-S^^ 6, neither Experimental Group I 
(students who attended the- i*aderborn Center) nor Experimental Groiip. • 
II (students who receive^ reading 'assistance in, tlxeir regular schools 
from teachers served by the Paderborn Center) showed significantly 
greater gaifts than students in the Control Group (students in a 
school outside the district affected by the Paderborn Center.) 

Tables 19 ahd 20 indicate that for. grade 7 the AUOGOV/H conducted 
was significant at th6 .05 level. Thus, difference s/among^ the 
adjusted -posttest means for" the three treatment grouf>s may be|g.nfer- 
red. When foip.ow-up tests were performed on. the adjusted posipest 
means \ of Table 19, the Control Group adjusted SDRT mean was sig-' 
nlfiifently higher than both the Experimental J and Experimental II 
adjtAted means. Ohis finding was certainly contrary to the^hypo- 
thesils of this objective.' • ' , ' 

The evaluation of individual performances on Objective I was per- 
formed by using a 90^ statistical confidence interval. This 
essentially amounts to determining whether or not each individual 
student enrolled in PLARG has achieved a non-random positive gaiQ 
in reading competency that wovQd occur by chance only 10^ of the' time 
or les^. Thus, for each student in Experimental Groups I and II, 
the r/cw score ga%-f-rom pre to posttest-was JUr^t ,c_onvert6d to .. 
standard error of measurement (S.E.M.) units. Each of these measures 
was then compared with the critical value of 1.28 associated with a 
one -ended 90^ confidence interval. • 

t 

Table 21 reports the summary infer mation concerning the nmber ot^ 
pon-c'hance'' gains made by the students in Esgp.e^imental Groups I/fend 
II for grades 6 and 7. It is important to note that the gains for 
grade 5 "feire not included ,in this table because the pretest and post- , 
.test involved two different levels of the SDRT test and the .raw 
score s were not direcily comparable • 

Table 21 



Numbers of PLA3C Students in Grades 6> and 7 
Achieving Non-Chance Raw Scores Gains in 
Reading Competency for Student Objective' i 



Grade^ ffroup ^ ^ .\ 


N 


No Gain 
.or. loss 


Nonsig. 
•*^n ■ 


Significant 
^ Gain 




Experimental II 
Experiments I • 


19 
.21 


3 (i4^). \ 


h (2lg) 
3 


, 12 (63g). o 
15 (72^)- . ^ 


7 


E3g)erimental $1 
Experimental I 


18' 
- i9. 


^^*C•22^J 

3 (J6^) 

e 


•6 (33g) 
■ h (2'i^) 


8 (U5^)" ^. 
12 (63^) 



In contract to the results 'rep.5^;pt6d on .groups performances, the 
individual gains in Tabl« 21: ^«^afr more encouraging. Of 
the 6lJh graders in Ebcperim0nta^1^:^^?^uKi^ I> 63^ and 72% re- ' ^ 

speatively showed significant fnoii^.pil^QO^^^ The percentages 

for the 7th grade were slightly IpiSrari "Here, 1^5% and 63% respective- 
ly moved significantly in the positive direction. These lower per- 
centages may pi'obably be partially attributed to the -cumulative 
frustration that an ineffective reader encounters by the time he 
reaches i:;he 'J-th grade • 

The findings summarized by Tables 15 - 21 suggest that^imited 
success 'was* realized in fulfilling Objective I. WhiieTio>st of the 
gains in mean grade equivalents displayed by, the E^qjerimerital I 
and Experimental II groups were\moderate in size, thej were sta- 
tistically no' larger than those exhibited by the^-Gontrol Group 
which received no special reading instruction. In fact, at Grade 7 
the' Control Grc);up Outperformed both Experimental Groups in a sta- 
tistically significacfc fashion. These resialts are^ certainly in 
' sharp contrast to the 1972-73 results in which iihe E^qperimentaX II 
Group otatist'ically outdistanced bothtiie Experimental I and Control 
groups for grades 5 and 6. One possible explanation of the dis- 
appointing group performances for the current year might be that 
students, after *eing in the program several years^ have possibly 
grown weary through the continual effort "made by the PLARC staff to 
increase their reading competency. These students, in a sense, 
have "spent" themselves and no longer appear to <*be able to reap the 
bene'fits of specialized reading instruction. 

In terms of individual gains, the 6th grade percentages of non- 
chance gains in both Experimental Groups roughly matched those of the 
1972-73 project year; Since the current 5th grade individual raw 
gains were not meaningful, grade 6 was the only one in which this 
type of comparison coiild be. made. Again, the percentages from Table 
21 and the percentages from grades 1| and 5 from the prior year 
support the notion that as the grade level increases, the student 
has a more difficult time in attaining a non-chance gain in reading 
competency. . 



student Objective Two — First Year — 1971-72. • 

Students, Grades 1-3, given participation in 'the Center will in- 
dicate a greater satisfaction 1} with school in general, 2) with 
reading as a subject, and 3) with self -achievement in reading than 
those students who have not participated in treatment at the Center. 

Evaluation - Pitst Year - 1971-72. , 

k 36 item attitude inventory was administered to the students in 
Experimental I and Experimental II. Due to the small population 
all students in the Experimental I group and Experimental II group 
were given the inventory. 'The inventory had four subsections: 
self-concept, self -peer-concept, school -concept, and reading-concept. 
The overall results ar^ reported below: 

mean var . s.d. sem rel.^ n. 

Exp. I 18.71 27.59 5.25 2.72 -0.72 ^ -62 
Exp. II ^18.00 20.i^6 \\.S^ 2.70 0.63 57 

•M- computed using Hoyt's Analysis of Variance ll^o^cv^^y^. 

The difference ir^raean scores of the two groups is not statistically 
significant. 



Student Objective Two -- Second Year — 1972-73. 

Students, grades lj.-6, in schools affected by Title HI, ESEA 
Paderborn Project will indicate -greater satisfaction with school 
in general, with reading as •& subject and with self -achievement in 
reading than students in th^ control group not affected by Title 
III, ESEA* 

* • 
Evaluation - Second Year - 19.72-73* 

An attitude scale wag designed by the Paderborn Staff which was 
intended to tap each of the areas listed above: (1) satisfaction 
with school, (2) satisfaction with reading, and {3) satisfaction 
with self-achievemoi t in reading. .Although the three categories 
were included in a single instrument the findfHgs suggest that 
Objecti-d^e II was not satisfied^. 



Table 22 



\ Test of Significance on Posttest Atti^^uct^ Saores 

^for Grades 4-6 for Student 'ObjectiveNlI 



' — ■ ■ ■ — nr" ' — 


Grade 


Control Exp, 

N N , Factors 


C6ntrol 
M6an 


Expi 
He an 


Diff * 
CE-C) 


Sii t 


✓ 


8 


Interest in reading 
18 Achievement in read. 
•• .Attitude toward, sch. 

r 


9.63 
7.38 
12.13 


9.22 -.41 
7.33 -.05 
10. 9U -1.19 


,bk .6]iNS 

.62 .o6ns 

.75 159NS 


5 


8 > 


Interest in reading. 9.50 
20 Achievement in read. 6.50 
Attitude towar<t. sch. 12.38 . 


9.^0 
6.90 
11.50 


-.10 

-:^? 


.50 .20NS 
.65 .62NS 
.61^ L36NS 


6 


17 


' I5tej?6st in reading 
21 Achievement in read. 
Attitude toward sch. 


8.82 

7.35 
11,06 


8.86 • 
7.1i| 
ll.i|3 


,0k. 

-.21 
.37 


.i|8 ,08NS 
.ii8" .i|i|NS 
.53 .7ONS 



No significant differences ^ound in attitudes between the 

Experimental Grouj^s and the Control Groups across all grade levels 
and attitudinal categoriej|.., , 



Student Objective Two ~ Third Year — 1973-7U* 

A. Students^, Grades 5-7/ in schools affec.ted by Title III, ESEA, 
Paderbom Project will indicate a greater satisfaction 

1) with school in general • ' ' 

2) with reading as a subject, and 

3) with self -achievement in^reading than those students in the 
control group from a school not affected by Title III, ESEA. 

B. A pre/post AttitiSde Instrument, developed by the evaluators, 
v/ill be administered to the students in the Title III program and ' 
to the control group students. 



Evaluation - Third Yeat - 1973-7i|* 

The attitude instrument used to evaltiate this objective vas a mod- 
ification 5f the S^lf rercep.tion Inventory by Soars and Soars, Ttiii 
modification' will henceforth^ be referred to as the Children's Self- 
Desci/iption Scale ( CSfiS ) , This instrument contains fojur subscales 
measuring a child's attitude toward (a) self, (b) peers, -(c) family 
and (a) school. All /totaled, .the instrument contains 30* statements 
where\ each statement ; loads under one of the abovj& subscales and is 
scorec^ from 1-5* A high score on a subscale,. is indicative of a , 
favorable attitude toward the particular target situation, (A copy 
of the instrument is included in the appendix of this report,) 

The above instrument was administered on a pretest-posttest basis 
to the Experimental I (Paderborn Group) and the Control Group of 
this sti^dy. No attempt was made to differentiate the results by 
grade level since the individual scores were not so identified. 
An aNOCOVA was perf orked^'<5n the pre and posttest scores for each 
subscale of the DSDS', Tablets 23 - 3G report the findings of these 
analyses for grades 5-7 combined. 
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Table 23 

Self Attitudinal Means for Student Objective II 



Groups 


^ -Pretest 
" Mean 


Posttest 
Mean 


Adjusted Pos'ttest 
. ' Mean 


Experimental I 


28 21. 5i+ 


22.01+ 


^1 .61 


Control 


■ 2Q(^ 20.1+1 


20.1+0 


20.57 




Table 


21+ 




ANOCOVA 


Summary .on Se].f Attitudinal Scores 
for Student Objective 11 


Sources 


33 


df 


-ms P 


Groups (adj.) 


21.1+9 


. 1* 


2i;V9 1.87* 


Within (adj..^ 


. 1690.35 


95 


11.1+8 


'■ : r- 

Total (adj.) 


■ 1111.81+ 


"96 





Table 25 • ' ^ 

Peer Attitudinal Means for Student Objective ^JI^ 



p ' „ Pretest Posttest Adjusted Posttest 

Experimental I 28 19.82 19.61 • 19.51 

Control 70 19.33 " 19.13 19.17- 



Table 26, 



ANOCOVA 


Summary on Peer 


Attitudinal 


Scores 






for- Student Objective II 






4 

Sources 


ss 


^ . 

df 


.^z^ 

ms 


P 


Groups (adj.) 


2.21 




2.21 


.16 


Within (adj.) 


1327.38 


95 


13.97 




Total (adj.) 


1329.59 


96 







0^ 



Table 2? ' 

> 

Family Attltudinai Means for Student Objective II 



Group 3 


N 


Protest 
Mean 


?o attest 
Mean 


Adjusted Posttest 
Mean ' 


Experimental I 


2$ 


21^.29 


i 2U.07 


2U.12 ' 


Control ' 


, 70 




■ 23.60 

V- 


23.58 



y 

Table 28 

ANOCOVA Summary on Family Attitudinal Scores 
for Student' Objective II 



Sources • 



Total (adj.) 



ss 



Groups (adj.) 
Vithin (adj.) 



5.,8U 
1712,34 



1718.18 



df 



ms 



5.84 

18.0J| 



.32 



36 

4* 



'-Tame • 2 9 ' . / 

Scho-ol Attitudinai^'Means for Siudent Objective I'l 



' ; : . . . 'I . 

Pretest Eosttest Adjusted Postteat 
^r°^P3 ^- • JJean 'Mean' , Mean • . 

" _J — 



Exp^imental 
Control 


.28 35.36 
70 . 33.71 , 


■ ■ ■ •* 
33.50 

32.80 


V 

33.13 
32.95 ' • 


* 

* 


t 

TaHle 30 . ' " 


I * 
« *■ 


• 


ANOCOVA Summary on School Attitudinal Scores 
for Student Objective II 

< A ' 

• ^ ' if : 


-it 


Sources 


' ■ ss df . 


ms 

r-^ *~ 




Groups (adj.) 
Within (adj.) 


3698.29 . 95' 


/ . .70 
' 38.93 




Total (adj.)'- 


3698,99 , 96 







The 'results can . be .s.unimarized briefly by ataUing that none of -the 
four «.ttiVu4inal subscales produced, a- significant xLiffere.nce be-. - ;> 
tween the adjusted posttest me.ans of the Experimental I and Control 
Groups. This,'6f cbUi'ee, implies that for each subscale the average 
gain (or lossj' of the Experimental I Group did not differ signifi- • 
.<5antly .from- the average gain (or' loss) of the Control Group; In 
".reality, on three of the subscales' (Peers, Family, apd SchoblJ,, 
mean losses in favorable attitude wej?e' posted by both groups from 
pretest to posttest. The only subscale that registered a mean gain 
in favorable attitude' waa tlie Se^f subscalia and in this case only 
by. the Experimental . I Group. • ^ 

The instrument use4 in this year's project' to agsess' attiJJudin^l 
changes'was felt to be far more sensitive than last yerar'a- in.stru- 
ment since it was liatterned «fter a standardized .test and contained 
many more ifems. This latter a'dtcantage produced the desired score 
variability that was badly lacicing in laat year' s^ make rsMft test. " 
In, spite of the above refine^en^;, only small jne an shifts wetfe ob- 
served on the four .subs<^ales and on three of these th^ movement was 
toward; a less favorable at'titude. It is 'somewhat encouraging to 
note that the Experimental Groyp I did show a mean gain of .5 'toward 
'e more favorable self -attitude . This rather' m6ager shift could re- 
present a very important outcome since'many authorities would argue 
that a child must accept himself before he accepts others.' Overall, 
However, the results of this section were" quite disappointing and 
certainly suggest that Objective II was not satisfied. 



student Obiec'tlve Three Pii«st iTesir — -1973. -72. 

A. '- Students will ^actively "engage, parent participation in reading 
i*einfor,cenient activities. ' . • 

B. - Parent participation record form. ' 



Evaluation - First Year - 1971-72. 

Beginning January 1+, 'the form was sent home with students' assign-' 
ments for parental signature indicating participation with child. 
Forms were kept in students' "file for record. As of March 31, 1972, 
students' files contained a total record of 160 instances ,t)f par- 
'ental, signatures indicating, they had, participated with ^the child 
in the assigntaei>t described on the form. . • 



Student Ob.iective Three — Second Year — 1972 -73 • * 

Students in Experimental Group I, who actively engage the family 
members in reading reinforcement activities will show greater gain 
ih "r^ad-^Ht^ competency that those ^students in Experimental Group I 
who do not so' engage. - ~ '^'^^ 

A^ random sample of 20 participating, families will be interview^ 
concerning the student/family reading activities. This will guar-- 
antee that the family painticipa'ted in the student's program. A 
statistical tes^t will be 'applied to the reading score of partici- 
pating Exj^eVimental. Group J students vs., the reading scores, of non- 
participating Experimental' Group I students to determine le'vel of 
significant difference . ; ' ^ ' 



Evaluat ion - Second Ye.ar - 1972'-73« . . ' 

' • et- '■ ' Table 31 , . . ' 

"Grade Equivalents Means on' the SDRT Reading.. Cotoprehens ion 
.J Subtest for Student Objective III" - 





Groups. 



Pretest 
Mean 



Pos*terSt 
- ''Mean 



justed^ Posttest 
Mean . 



Home Assignment '20 " :2'*kS 
Control - , " 2.58 



' .2'. 98 
341- 



3:05 
3.33 



f/ERlC 



.1 



39 

* 51." 



Si . 



C 5 



Table 32 

t 

' ANOCOVA Summary on the SDRT Reading Comprehension Grade Equivalen 

Scores for 'Student Objective III 

0 ■ ' 

t 



Sources ^ 


ss 




ms 


P 


;Groups (adj.) 
Within groups ' (ad ) . 


.72 

26.59 ' 


1 

35 


.72 

.76 , 




Total tadj.) 


27.31 


36 








1 




i 





Th^ evaluation of Objective III was carried out by employing ANOCOVA 
on the pre and posttest gra4e equivalent scores for the SDRT reading 
comprehension subtest. Table 32 indicates that the f-ratio .was non- 
significant. Thus, it may l?e inferred that the adjusted posttes^ 
mean for the ^Home Assignment group did not differ significantly from 
the adjusted posttest mean for' the control group. (See table 31;. 
Moreover, a close inspection of Table 3I indicates that both groups 
made rather modest gains in mean grade equivalent scores from pre to 
posttest. 

Note: Student Objective Three was terminated after, the second year. 
The objective was terminated because o;f the difficulty encountered 
in establishing a statistical design that would jLald meaningful 
results. In order to'develop this objective, the scope of the pro- 
gram would have had to have been expanded. This waa financially 
impossible. * . 



studen t Objective Four' -- First Year — 1971-72. 
none 



Student 'Ob'.lective Four — Second' Year 1972-73. 

Students that attend tliie Center.- will increase their knowledge -in 
reading-study skills. 



Evaluation - Second Year - 1972-73. 

The Work-Study Skills Test of the SRA Achievement Series was ad- 
ministered pre and post to determine if .gain in knowledge of reading 
skills had been attained by the student participants. The data waa 
treated statistically. The .P5 level of significance was utilized* 



Table 33 " ' 

.^Tests of Significance on SRA. Work-Study, Skills .Grade Equivaleht 
Scores for Grades i|-6 for Student Objective IV 



' — ' — ' ^ ^ ; ■ ' ' ^ \ — ' — 


Grade 




Pretest 
Mean 


Posttest 
• Mean 


DifferjBnce 
Post-Pre"^ - 


S.E.' ■' 

* 


t 


6 

4 


18 

25 
21 


3.39 
3.96 
i+.31 


'3.69 
i+.25 


.30 
.29 

'.16 • 


.20 . 

.25 
.20 , 


1.50 NS 
. I.l6 NS 
.80 NS 



The previous dat^, indicates'^ that Objective IV was. not fulfilled, ^ 
although mode ^ observed mean gains .-were achieved in wpjck-study 
skills at all grade levels. ; ' ' ^ 



jBtudent -Objective Pmir Third , Year 1973\7U* 



No%e: This obje^ctive was identified as Student Objective Thr^e 
for the 1973-7ij. scjiobl yea;*, but it should havgLj^eejijUien- 
. tifie^d as Student Objective Pourl ^The proljlemT^is" caused^- ' 
by the termination of Stt^dent Ob jective Three . Anoth^i;? 
objective was added and should have replaced the ' terminated 
objective . ^ Unfortunately in developing tlr^e continuation/* 
report Objectives Pour and Five were elevated one position' 
and a new objective was introduced .as Student Objective Five, 
The correct order is maintained in this report. 



A. Students, grades ^fA> and ? that attend the Center, will iacrease 
their knowledge ii^rea^ng- study skills. 

B. Reading-study skills evaluation will be administered pre and 
post utilizing the SRA Work-Study Skills Test. 



Evaluation - Third Ye^ - 1973-71].. 

The evaluation of Objective Pour was conducted by using the t-test 



on the gain scores associated wi^h the SRA Work Study Skills Test 

~ e 3I4. ^displays the re3ults " 

' >ac: 

gains proved nonsignificant when the critical statistical bounda.ries 



for the Experimental I group. Table 3i|. , displays the re3Ults or this 
analysis for each of the grades 5-7* A^all a^ade levels, slight 
mean improvement were realized from pretest to'posttest, but^^xhese 
gains proved 
were applied. 



' ^ ' Table 3k ^ . % ' ^ . ^ S^'^ 

Tests of •Significance on SRA Work Stujiy Skills Gr^de Equiva3;6flt 
Scores for Grades 5-7 Ifor Student Objective Pour ^ ' , 



Grade 


N 


Pretest 

' Misan* 


* Posttest . 
' *Mean 


M^n 


S . £ « ' 


■ ^ .' 

r * ^ 


5 

6 

■7" 


12 
19 

9 


3.76 
3.52 


4.21 


' i2:9 
.73 
, . .69 

. 1 • ■■ 


■ .17 
.38 

.36 


I..7I ' ■ 

1 . 92 . ^ 
. 1. 92 



previous data wquld 's^lgge3t thar^bJectiVe Four was, not .ful- 
filled! fiowever, modest obiervedmean. gaitifi were achieved In work- 
-b^udrW^^t Ill-^ade.revexJ^^^ S^- I I^'m 

exceeded the expected grade equi^err-t gain'over t-he 6-mon|h span 
between^e atjd posttest. It Is again conceivable that both the 
ahSt du?Stilb of this program and^'the. cumulative- frustration on 
?he l^rSf tSe student^contribut6d to these ^re^ther small improve- 

rments* , • ? ; ' . ^ •/ • 

I • • « ^ . ' 

b' • • ^ • . : . ' , 

"s t^ecial-Work Studies .Student Obiective - Third Year- 1973-7i|. 

Thirtv 7th and 8th grade students of the Millstadt Elementary 
■School identified as deficie^ in Reading Vocabulary and Reading 
Work Stiidy Skills will be provided with an individualized Geo- 
graphical Educational Program that reinforces readingjocabulary 
fnd readiftg work study skills. Twenty-seven of the thirty students 
will attain -a minimum gain of at least one grade equivalent. /• 

Evalua t io n -Spe c i al Work Studies Objective-Third year-1973-7U. 

The group performar?ce part of this objective was evaluated by 'employ 
ing the t-test on the grade equivalent gairt scores from the Work 
Study Test of the Iowa Test of Education al Development- . . 
^able 3^' presents the summary data for the specially selec.ted 
groutrti from both the 7th and 8th grades. The mean gains in .gr^e . 
eouivfilent scores for both the 7th and 'Qth grade groups were sig- 
nificant beyond the .001 level, In addilrlcn, both mean gaifts were 
substantially' above the expected grade equivalent gam for the • 
elapsed time span from jiretest 1<o posttest, \ 



Table 35 ' . 

Tests of Significance on ^ED Tes,t W 
Grade Equivalent Scores fol* the Special 
Woi'k Stuc^s Student Objective ' 



&rade N Pretest ' Posttest Mean S.E. T s 

Mean Mean Gain 
. • i_ i — ■ ■ . 

7 30 ' 5.22 6.1U - .92 . 20 , k.]|7«** 

I 30 6.02 . 7.U --l? . 8.^1^ 



The infdividual gains made by the 7th and 8tB: grades groups are 
categoriMd in Table 36. It ;Ls indeed striking that 12 out of the 
30 students in grade 7, and I? out' of the 30 students in grade 8; 
garnered gains in excess of one grade equivalent* 



Table 36 

Numbers of Students Achieving Cer 
Gains on the ITED Test W for 
"l^ork Studies Student Ob 




rrade Equivalent 
)ecial 
jctive 



Grade-* , 


N 


Loss In 


No 


Gain 


.1 G.E. to 


More than 




G.E. 


in 


G«£ • 


1 G.E. 


1 G.E. 


7 


30 


8 




0 


10 


12- 


8 • 


30 


1: 




1 


11 


17. 



















The resu3,ts on this Special Wrrk Studies Objective are quite im- 
pressive • Not only were bothj3i6 ^ gamin s significant at the .001 
level, but the 8th grade^^gtfinwas we^l above the targeted one grade 
equivalent level and the 7th grade gain approached thLar. coVeted 
level. No less impi?es3ive were the high frequencies of students 
that made individual gains in exceis,bf one grade equivalent. 
Perhaps the only sour note was that the program, .did not attain the 
stringent criterion set initially of 2? out of 30 students vfith 
minimum gains of one grade equivalent* Howevej?, in retrospect this 
goal seems very unrealistic. In summary, one is compelled to say 
that the Individualized Geographical EdUQ^ion Program instituted. 
Xn this ob^c^ive was an unqualified succes^ 



1971-72. 

-A 



Studemt Objective Five — Second Year ViilZ-l'}>* 

Students, -as a group, in grades one, two and three* that are in • 
the PLARC mater teacher individual reading progran^ will after five- 
months of parti4ipatiorv demonstrate a gain in , the attainment of 
the specific reading behaviors: vocabular y an d comprehension. 

Participants will attain a meari gain significantly above one grade 
equivalent on a standardized instrument measuring the specific 
reading behaviors of vocabulary and comprehension. , EachJ student 
will attain a minimum gain of at least one grade equivalent. A 
statistical hyphothesis test will be conducted on the group mean 
gain equivalent scores, a tabulation will. be made on the number of 
students attaining a minimxim of at least one grade^ equivalent. 



Student Obiectwe Five First" Year 
none 



Evaluation - Second Year - 1972-73'. 
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Test of Significance on Grade Equivalent Scores on the 
Gates-MacGinitie Test for Grades 1-3 for Student Objective V 



Pretest Postteaf Differencq, 



Grade Subtest 


N 


Mean 


Mean 


Post-Pre 


SE t 


1 


Vocabulary 
Comprehension 


10 


1.10 
1.38 


1.91 
1.82 


.81 


.16 5.06** 
.17 '2.59* 


2 


Vocabulary 
Comprehension 




1.73 
1»60 


2.50 
2.25 


.77 
•.. .65 


.12 6.it24Ht 
. .12 5.li2* 


* 

■ 3 


Vocabulary 
Con3>relienaiQn 


17 


2.12 ' 
2.08 


"2.73 
2.19 


.61 
.11 


' ■;16 ■ 3.8l«* 

.08 a. 38* 



* p .05 

p .01 



U5 
57 



No pretest score was available for on6 subject on comprehension, 
there.fore means were' based 6n 23' subjects for thi'a subtest. . 

This objective was evaluated by conducting a t-test on the group 
mean grade emjivalent gaiti score^. for both the Vocabulary and Com- • 
preheSsion subtests for eech-sa^Aft 1-3. A tabulation was made of 
the number of students attaining, a minimum gdn of at least one grade 
equ^ivalent, 

-Table 37 presents the re sulta of the, success in meeting this ob- 
jective. The' results are both disappointing and encouraging. In 
terms of group data, it. can be seen that at 6ach level- I first, 
second and third grade) the students as a group made significant 
gains. 

The Tirst graders showed gai^»s in vocabulary which were significant 
at the .01 level, and gains in comprehension whi6h were significant 
at the .05 level.. This was found in spite of the fact that for 
first graders, more than half of the group performed at the lower ■ 
-limit .of the test in grade equivalent scores on the pretest. This 
means th^t^ in many cases, gains of several raw score points cduld 
have been effected with absolu^eljr no corresponding gain in pacie 
equivalent soore. In terms of individual gains, only 3 of the 10 
students gained as much as one ye-ar. in grade equivalent scores on 
vocabulary, "and 2 of the dO students e^xperienced this much gam m 
comprehension. However, 'in "asse ssing the s.uccess of t^e program, 
it should be remembered that in J*arting with a group *hich has 
problems in feading/ .it is n^t unusual for such a group to fail to 
register any «4ihs at all during a'-brief interval such aS" the 5 
month duration of the^ experimental program 

The second graders performed much better4s a group, in that_ 
differences in gain scores in both vocabulary and comprehension 
were found to be ^significant at the .01 l»ve.l. -NmS of - the 21^ , 
students attained' a gain, of one year or mo^e In "grade, equivalent ^ 
• scorea, in vocabuXary, and 7 of 2t5. improved one year or more in . . 
grade equivalent ' score in -.tt^e arie^.of (JomprehTerjaiorw ^If th^ 
criterion used- vere-; equal to 6ha' a'c^ual t^e inyoived grade 
eqiivaient score of .5) then; in vob^bulaj-y, 1.7. of. ths-2l+ were suc- 
cessful in keeping abr'aast of -the progreps of. average students, ^nd 
13 o'f 23 reached that level in comprehension. . ^ ' 

Tl-io third graders showed Improveoxents similar to the other two groups 
in the area of vocabula3?y, where a di-jfference significant at the .01 
level' was found. However, the pre and post test Means m compre- 
hension, were not significantly different from one another. Jn 
addition; only 5 of 17 students on the vocabulaf-y subtest and 0 
of 17 on the Comprehension subtest made -gair^Qf ofi6 or more grade 
equivalents, ^ , \ • 



ERIC 
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In terms of the overall effectiveness *of the program in realizing 
Objective V, qualifi^d success was achieved in grades 1 and 2, with 
greater sia'cces^ at the second grade", ^ere the mean gain it3 cm- 
''prehension was greater , than the length of time lapsed. This is 
especially. impoj?Jtant in light of the study having begun with studeitb 
who trere behind their age -pi a cement^ thus indicating a hiatory of 
less than average progress. • ' . - „ - 

Finally, it should be indicated why the word "qualified" was used 
to describe the success under this objective. In the strict sense 
of the statement of this rather "lofty" objective, the grade groups 
did not attain mean gains sigriificantly above onegrade equivalent, 
nor did a substantial number of students as individuals advance one 
grade equivalent or more. However, in view of the time limits 
imposed on the treatment, the sheer number of significant gains under 
this objective' would attest to its success, especially when the 
target population-is one already identified as experiencing dif- 
* ficulty in reading achievement. 



Student Objective^ Five Third Year — 1973-7U- 

Students, as a, group in grades kindergarten, one, two, three, fovr 
that are in the PLARC Mcster Teacher Individual Reading Program 
will after five months of participation attain a meaji gain sig- 
nificantly above one grade equivalent on a standardized instriiment 
measuring the si>ecifip reading behaviors of Vocabulary and Compre- 
hension • Each student will attain a minimum gain of at least one 
grade equivalent. 4. 

Evaluation - Third Ye^ - 1973-71+. 

The group performance part of Objective Five was evaluated by con- 
ducting a t-test on the group mean grade equivalent gain scores 
for both the vocabulary and comprehension subtests of the Gates- 
M ^cGinitie Test , for each grade 2-i|. Table 38 reports the results 
of the statistical^ tests. Sint:e only posttest scores were avail- 
able for the PLARC studbnts in grade 1, no results are reported 
for this gr^de in the table. - 



» Table 38. 



Testa^ of Significance on Grade Equivalent Scores on ^the Gates- 
. MacGinitie Test for Grades 2-4 for Student Obj. V. 



Grade Subtea-t N " Pretest Posttest , Mean S.E. ' t. 

7 Mean Mean Gain 

"Vocabulary 1.93 2.57 -^.Sk - '23 2.78* 

Comprehension 9 i.8l- 2.06 .25 .18 1.39 



- Vocabulary 2.56 3*38 «82 .26- $.l5^ 

Comprehension ^ 2.21 2.89 .68 .26 2.69* 

Vocabulary x ^. 2.67 , 2.79 -.03 .30 .10 

^ Comprehension ~^ 2.23 2.23 .00 .29 .00 



a* p<.or' 
* P<.05 



Examination of Table 38 shows, that vocabulary gains for grades 2 
and 3 were statistically significant at the. .05 and .01 levels re- 
spectively* * Coiapre hens ion gains were significant fov only, grade 3 
and attained only, the .0$ level in this instance* Since many stu- 
de'nts in grade had only pasttest data available, the statistical 
^test based on a sample size of ^ for this grade has vemr' little 
meaning in terms of success or failure of the abjectivy* 



Addijbional light xs shed on the evaluation of Objective Five by 
stuciying the ihdividual gains for the students in grades 2 and 3- 
The breakdown of this data is giv§n in Table 39. 



/ Table 39 

Humbers\of PLARC.. Students in Grades 2-k Actiieving 
Certain Grade Equivalent Gains on the 
Gate^ MacGinltie Test for Student Objective Five 



Grade 


Subtest 


V N 


Loss in 


No Gain .1 
in G«£« 

'} . 


G.E. to More than 
1 G.E. 1 G.E. 


2 " 


Vocabulary 
Comprehension 


9 




0 
1 






Vocabulary 
Comprehension 


. 13 


2 

3 ; 


-r-(- 

0 V 






Vocabulary 
Comprehension 


3 


2 
1 

•* 


0 

1 


1 0. 
1 0 



Probably the most striking feature of this tablei^ that 6 out of 
the 13 studentTso^ grade 3 made vocabulary ^^irrs of more than one 
grade equivalent /^corei . Also 8 put of the same 13 students made 
comprebaiflion gains of from .1 to 1 grade equivalent score. At 
the second grade level It can be seen that many of the gains in 
both vocabulary and comprehension piled up- in the .1 to 1 grade 
equivalent category. 

In terms of overall effectiveness of the master teacher program in 
realizing Objectives Five, great success was achieved at grade 3. 
Although both the mean gains in vocabulary and comprehension, fell 
short of the desired goal of one grade equivalent or more, both 
were statistically significant and were greater than th^ elapsed 
length of" time for this year's program. Moreover, on an individual 
basis, almost one-half of these students tallied gains in excess 
of one grade equivalent score on the vocabulary subtest. At grade 
2, the success of the program was ^somewhat limited. The vocabulary 
gain was significant and also above the elapsed program time, but 
the comprei^nCipPgain did not achieve such prominence. Of course, 
Xar too few observations were available at grade, to make any ac- 
curate statements. All '.things considered, these results must be 
interpreted as satisfying Objective Five in spirit if not in letter. 



A. Identify learners with perceptual and auditory deficiencies, 
age five to twelve ,^ grade s k-k> and prescribe and initiate a per- 
ceptual-auditory education program for each deficient learner. 
After one year of treatment each learner will demonstrate siLgnl- 
ficant gain in- auditory and perceptual skills that are directly 
related to the basic tasks of Reading. 

B. The auditory analysis test and the visual analysis test will ^ 
be administered to all k-^ students that have previously been iden- 
tifted by their classroom teachers and/or diagnostic reading si^s 
as being deficient in reading readiness or reading skills. These 
tests will be administered at the students attendance center during 
the first two weeks of September. Students that demonstrate an 
auditory or perceptual dysfunction will begin attending the Center 
the second week of October and their attepdance will terminate 

the last week of April. The instructional time shall consist ol 
a minimum of U day per week. The student will be guaranteed a 
minimum of two hoursjof correctional instruction in the area of 
his diagnosed dysfundtion. The- perceptual/auditory curriculum 
materials to be utilised will be those that have been developed 
at the R & D Center oft the 'University of Pittsburgh. . 

C The AAT, VAT and The Gates MacGinitie Tests will be adminis- 
tered on the pre -post basis to the participants. The raw gain 
scores of the AAT and VAT and grade equivalent gain scorers on the 
Gate 5-MacGinitie will be computed. Using .01 as the level of sig- 
nificance, the mean gain scores of these instruments will^be tested 
for statistical significance. 

In addition, each individual's gain scores on the Gate s-MacGini tie 
will be examined and compared to a^-gixad^ equivalent gain criterion 

of .5. m 



Evaluation - Third Year -•1973-7^." , . 

The data available for analysis under Objective Five was much less 
than the ^original plan prescribed. Two groups of kindergarten 
students who were identified as having auditory or perceptual 
dysfuncti-ons constituted the experimental and control groups. The 
experimental group repeived six months of instruction using the 
perceptual/auditory curriculum materials demLoped at the University 
of Pittsburgh. Posttest scores on the Gates-MacGinitie Readiness 
Teat w ere obtained for both groups and statistically analyzed via 
the t-test. Table i^O gives: the results of this test. 
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Table kO ' ^ ■ 

T •» 



Test of Significance on Gates^MacGinitie Readiness Scores 
for Perceptual -Auditory Program in Student Objective -Six 



^ — ; ^ ■ r 

Groups . * N ' Means ^ ' Difference SE 



Experimental 12 76.. 08 

Gdjxtvol 21 ,65.52 



,10.56 i^..98 2. -12* 



\ 



The observed -difference in *po stte«st means was 10^56 in favor of the 
Experimental Group. This difference produped a t-.valtfe '^of 2 ,12 
which was significant at the- .05 level! 

. In terms of the original statement of Objective" Six, 'the results 
•reported in' this Section can only be inte3^preted as partially 
. fulfilling, this- objective. , Since crnly kin4^Tgart;en and pbsttest 
data were avaiiabl&,. the signfficaAt findings certainly diminish 
the internal, and e::d;ei'nal vs,lidi-ty of the experiment. 

. .■• . . ^ • . . ■ .. , .. 

•I . ' 



\ 



SEnT ^QK-^II - A. OBJECTTVES THAT HAV R ATTAINED V' 

<\° Teacher Oblective One^ • ' ^ 

Teachers in grades (1-3) (U-6) (7-8) who participate irf in- • 
service training sessions at the Center will demonstrate com- 
.petency in diagnosing reading skills to 90^ cirterion. 



2\ ' Techr>ique for Evaluation. 

The fir'st year of the program the mastery technique was used 

to assess objective attainment. 

' ' ' . - ' 

■".A new pi-oject director was employed for the second and third 
' .years of •the >ogram, and" the project director and program 
,.. evaluators determined that the utilization of the, mastery^ 

tec-hnique provided a poor statistical evaluation of objective 
attainment. Therefore th^ technique for/ evaluation for the • 
second .and third years of the program vks changed to read as 
• •■ ' \ ' . _ • ■ 

follows: ; • . . , 

' - >e-Poat tes t utilizing » ^statistical t-test will be - 
. <■.. used to assess success . t 

'■The objective\for-the second and ^third year was chaja^d. 

■'. toVead as follows: , * ' . ' 

' . ' ' ^' . n^^o.>.»r.. f^rndes (ii-.e ) Who >rticipate in in- 

' -a«T>vir>.R fcra l^TH^^sSi o ns at the Center will show sig-, 
f- . gfT.»nt-^ains th. <^ level in ', t h e abil ity to diagnose 
readinig- behavior." ^ . 

■ ' - ' : / ■■■■■./ ; 



. ' . Summary Eval ua t i on > 

Year One; Nine of twelve teachers from grades one;, two and 
three .achieved the desired ^0% competency criterion*. 

^ Year Tv/6 and Three: ' Th§ teacher.s »fi*om'^grades four through 
^ . eight attained gains significant^ ^t the .01 level. 



U>\ Fa.ctors that Facilitated Accortiplishmeftt . . • ' 

i) ,The inservice training program was extensive and 'consisted 
of summer wj>rkshops, r^ine Saturday workshops during each 
•^chool y^ar,. plus- a minimum of three half days of released time 
^during the school year. The inservice programs were reading ' , 
orientated. , • . '/ - 

b) The teacher's employe'd by the projebt functiope^ as master- * 
'teacliers and woi^ked directly with the classrp^ teachers. This 
.phase of the^Ji^ogram probably was more re^aisible than other 
program aspefets for the successful ait^nment of this objective 

c) A realistic, .pi!^dst video test was developed and thereby 
a simulated real teacher diagnostic technique was evaluated. 
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Teacher Objective Three.' '' t v . . 

Teichera in gi«ades'd-3) (l|-6)- (7-3) will demonstrate increased 
ability to prescribe appropriate materials for the development 
of specific reading behaviors. ' ^ > 

Techn ique for Evaluation* ' 

— ^ . • . ' 

The first project ye ar^^ pre/post test comparison Was utilized 

but no statistical technique^ was employed* Thi^ resulted in 

providing a non-relevant evaluation. An evaluation -^tectiriique 

was made by the pew proJ§,Gt director and the project- evalviators 

and therefore the evaluation technique employed for the final^ 

two project years "was a pre/post teat employing a statistical 

t-te.st to assess success* < \ - , * , 

Summary Evaluation. ' - .^4 

.'Year One: .teachers grade.3 one/ two and three improved by an 
average score of in the ability -to list various re- 
mediation techniques. ' , " - - 

Year-T^o.: ^Teachers in grades fpur^ fivQ.and -six demonstrated 
a gain in t>he ability to select appropriate remediation 
"•'techn^ies significant at the *0^ level* 

Year Three: Teachers in grades seven -and ei^t demonstrated 

a gain in the ability to select appropriate remediation , 
technique but the gain did not reach statistical sig- 
nificance* • ^ ' . , 

Factors that Pgcilitated Accomplishment* 

a) ihe ext9nsiye inseryice training pfogram* See ^ Teacher 

Objective One, Page 1* 



b) Th« realiatic natijre pf the teat in an applied setting was 
facilitative , but might have worked against thia particular 
objective in that the identification of appropria/e remediation 
techniques waa contingent uporj correct ?iia^oaia. pf a reading 

I r 

problem. a?hia ia ideal inaofar aa meaauring a uaeful improve- 
ment^ but greater aupcesa might have been ge.en if a more 
artificial teat had be^n uaed in which remediation techniquea 
had^,b©'en matched with pre-identif ied reading problem 1» in a 
i<6te -learning faahion. 
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Teacher ' ObijectlvQ Four> 

TeacJxer.B in grades** (1-3)^ (4-6) ,C7-8) will inci!ease competencjr 

in developing appropriate evaluation (questioning) devices 

for reading comprehension. . \ . . , ; 

Technique, for Evaluation. - . 

For the three pi^ojedt years the teachers, were* expected tp 
demonstrate the ability to increase their utilization of the 
evaluative an^ the, interpretive; type of questions and simul- 
taheously decrease thftir utilization* of the 'literal type of 
questions; . ii ' 

First year a pre -1^03 1 tea^t comparison was made but no statis- 
tical te^t was conducted. / /' • ' . ' , 

A correction * in the statistical technique was made for the 

' ' ' . ' f,' * 

aecopd and third project y^ars. **''' ' ' ; * 

For the second arid thirdiyears a pre-post test utilizing a 



statistical, t-test was used to asses-s success*. 



Summary Evaluation. . * - * , 

Year. One: * Sizabl^ gains ^were observ^d^ln int^rpre'tive and . 

evaliiatiye type questions utilized by teachers in .grades, 
•one, two and three • * ' , . ; . a 

Yeai* Two: Teachers, ih^'grades four, five and six demonstrated . 
gain in the utiliza*ibn of^^terpre tiye apd evaluative ' 
* * type questions significant afrtlie .01 level. * 
\. ' r . ' " ' ' ^ . ^ ' ' ' ' • . 

•Year Three: Teachers in grades seven and eight* demon^Stra ted 
^ 5!izable gain in the utilization .of Interpretive and* ev^l- 

* 'ujatiye type question's but ^he gain did pot/reaoh statis-, 
tical. 'significance. ' , . ^. ' - v 



Factors th&t Pacllltated AcootapIiShment> 



A. The extensive inservice training program. See teacher 



Objective One on page -^^ 



B* Bie outstanding consulUint service providec^ by Mrs, Ruth 

Richardson, Ph.D. Ed., S.lil*, Edwardsville , Illinois and Mrs. 

Genevieve Langston, Ph.D., Ed., "fcureka College, Eureka, 111. 

C. Master teachers Miss Kaijen Hutche.son an4 Mrs. Betty Reed 

* . ♦ 

working diligently/ .with pro ject tsachers on a one to one basis. 
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!• Teacher Objective Five > X ' 

Teachers In grades (1-3) (1|-6T^ (7-8) will Increase content 
knowledge about the language arts process. 



Techniques for Evaluation. ^ - 

The statistical design for the first project year was nebulous. 
The l?elatlonship' betw6en procedures for objective accomplish- 
ment and obj^ective ^e.valuatlon was very poor. 
The first year evaluation was redundant and therefore the 



second and third year the objective was utilized as a^-stmmary 
objective, and the technlqu^^^-e^loyed was tp summarize the, 
accomplishment of objectives one 1;h^&ug&^ f our. 




3* a Summary Evaluation. 

Year One:' Teachers in grades one, two and three demonsBrgrbe^- 
gfilins in the acquisition of content knowledge in language 
arts significant at the .01 level • 

Year Two: Teachers in grades four, five and six demonstrated 
significant statistical gain for objectives one, three 
and ,f pur. ^^leocre f ore, ' based on a review of individual 
teacher pbjectiv^^^.-Jth'is objective was succe^sfulj 
accompli shed # 

Year Three: Teachers in grades severT^^and eight demonstrated^ 
gains for objective one, three and fdur. Therefore", 
based on a review of individual teacher^bfej^tives, this 
objective was marginally successful' becausest-^iMstical 
significance was not attained for e'fich objective^ 
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1. Teacher Objective Six — Third Y6af — 

A Sequential Reading Curriculum written in objective form, 
that provides the learner with the opportunity to utilize 
alteijhate styles of learning how to read and provides the^ 
teacher with the opportunity to match varied types of educa- 
tional materials and equipment to the learners individual styles 
will be developed for utilization of the seven cooperating 

^""^'"^^x^ool districts. The curriculum- will be completed by April 
7, 197i|. 

2* Technique for. Evaluation. 

Survey of teachers concerning potential utilization. 



3^ Summary^Evaluatifon. 

Evaluation-Third YBar-1973-7i|. 

Sequential Reading Curricvilum written in objective form was 
developed by April 7> 197i| and reproduced by April 30, 197i| 
and distributed to all teacher -participants May 197i|t A * 
survey o^ the teachers indicates that 60^ intend to utilize the 
curriculum as an aid for planning their instructional reading 
program. 

i|. Factors .that Facilitated Accompli shment. 

The ability of the Paderborn reading, specialists to organize 
the reading curriculum in objective form contributed to ob- 
jective accomplishment. 

. ' 59 ' ' 
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student Ob.lective Orie-> ^ 

A. Students, grades (1-3) {i|-7), will ^ittcrease their competency 
in reading in ,th0 following patterns: using a 90% confidence 
level it is possible to^ say that any student moving 1.28 
standard error units has gained in a non-random manner. That, 
is/ over the long run, a gain of 1.28, or more SEK units would 
occur by chance 10% (or less) of the time. 

B. For project years two and three the gain scores of Exper- 
imental Groups I arid II win be compared tc the gain scores of 
the Control Group. 

; 

Technique for Evaluation. 

Project Year One: Two experimental groups were utilized* 

One group was comprised of the students attending the 
Center for reading assistance and one group was receiving 
help in their schools. 

' ' The evaluation methodology consisted of utilizing the con 
. fidence level approach of assessing ind'ividual gains. 

Projed't Year Two and Three: Two experimental groups (one at 
the Center and one in the schools) were compared with 
a control group of students attending a sjchool that did 
not receive prog3:'am trea*tmeht. * 

The evaluation methodofogy consisted of an analysis of' 
covariance to detemine statistical significance arid of 
assessing individual gain by utilizing the confi6.ence 
level approach. ^ , 



Summary Evaluation >^ 

Year One: U|U.izing the confidence level it can be stated that 
succes^was attained, in that a range of 60^ to 90% of 
the students achieved significant gain a in either vocab- 
ulary and/or comprehension, 



60 



0 ' 

■ Year Two: tJtUizlng an analysis of oovariance a atatis-iically 
significant dif-ferencein posttest adjusted means, was 
found (grade five at the .01 level and grade six at the 
.05 level). The differences were in favor of the groups 
being helped in the regular classroom through the use of 
a^'master teacher. 

Confidence levels indicated significant gain that ranged 
from to, 100^. 

Year Three: No significant differences were found to f^or . 
the experimental groups. . 

Confidence leveis itidicated significant gain thfct ranged 
from kSi to 12%, , 

The objective was met successfully, partlc*larly in the child's 
first year of program participation and at the lower grade ^ 
leveld. The second year of program operation produced the 

"greatest statistical gain. This is the only program year in 
which the master teacher was scheduled into the regular 
teachers classroom for a minimum of ' one half hour per week. 
During the first year of the program the master teacher colaoept 
was not^utilized and during the third year of the program,' a 
rigid schedule was not imposed because the classroom tfeacher was 
allowed the option of requesting aid or rejecting aid completely. 
The statistical results of this program seem to indicate that . 
* the utilisation of a master teacher in the regular classroom" 
to aid the classroom teacher is an efficient method of. improving 
the reading gkills of children, .|>rovided a definite schedule 

^is established for master teacher -clrfssroom teacher cooperation. 

. Factors that Facilitated Accoaplt'shment. 

The inservice trainii:ig program provided ^achers with more 
expertise in the teaching of reading. 

. , • " " . 61 • . • 
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The master teacher concept provided a' specialist at the dis- 
• posal of the clsssroom teacher » 

A learning center provided a model enabling the schools and 
teachers to begin to individualize instrucTiion. 
The earlier a child was identified as a disabled reader and 
provided a reading program^ the more successful the attainment 
of this objective* 




/ 
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Stuckfnt Oj:)JectlYe ^Four> 

StudenJbs that attend the Center will incTease their knowledge 

in reading study skills* (gi?ades 1^.-6) arid (5-7 | 

♦ 

Technique for Evaluation* 
Year One:* Objective wasn't included.. 

Year Tv;o: Pre-post test con5)arlson using a t-test on gains 
in the S.R.A. Work Study^ Skills. 

Year ^J^iree: A- Pre-post testLcomparison using a t-test on gains 
:^^;:the , S.R.A> Work Study Skills > ^ • 

B. A pre-post test coi^arison utilizing t-tests on gains 
on the Iowa Test of Educational Development Test W- vork . 
studies. 

4 

No*e: A concentrated educational effort was conducted 
for pne school district. Special work studies' 
objective was established for this group of 7th 
"X"^and ovth grade students. ^-.-^ 

Summary Evaluation. 

k. ' Pre-post^ test scores, were subjected to t-test of gains. 
For both years gains w6re observed bu£ they*'did not reach 
statistical significance. ' . . ~ . ^ 

B. ' A pre-post test comparison utilidng a t-test revealed gains 
significant at the .001 levels ^ * . ^ 

• / * ' > ' . ■ 

/ « ■ ^ . ^ ^ • - - , 

Factors that Facilitated Accomplishment. 

<» * " ^ . * 

The success of the objective was minimal because the basic 
objective assumed that ^reading study. skills would improve along 
with general improvement in reading. ' Although observed -gains 
wer6 obtained, they were no-t statiti^ally. significant. However 



J 



the /specif ic objective in year three for 7th and 8th gradle 
students, concent;rated upon imjproving work study skills. These 
studenji^s did demons t3?ate significant gains at the .OOl. There- 
fore, ^nce.ntration Jupon the development of work study skills 
by the students facilitated, objective accomplishment* 

X 
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1. student 'Ob jective Five Second and Third' Year3-- 1972-7ii» 

• ■- ; " • - , r^i- 

students, as a group. In grades one, two, thr^e, four thar are 

I- ' ..^ . ■ ' ■ - ' ' ' 

In the PLARC Kaster T^abher Individual Reading Program will 

' * • . 

after Xive months of participation attain a mean gain- aignifi- 
' cantly above one grade e^i^^ivalent on a standardized instrument 
measuring the specific reading^ behaviors of , Vocabulary^ and^C^^ ; 
preh^^Trt4on. Eacl^ student wiil attain a minimum- gain of at^ V ^ 
" least one grade equivalent* ' ^, » 

2. Technique' for Evaluation > - . - ; • ^^-^^ ^ : ' . * 
A t-test of mean gains by grade le'^rel was utilized. 

3. Summary Evaluation* ^ > ' ■ . 

1972- 73: Students in grades 1, 2 and 3 demonstrated Significant 
. improvement in both^ vocabulary and comjirehenslon at either :the 

' ■ .01 or- the .05 l^vel. - ' ' . 

1973- 74: Students in grades/^ and 3 demonstrated significant " •» 

' ' ' - , * • * ' 

improvement in vocabulary at tlie .01 or the. .Q$ level* , S,tu4enta 
• in grades 3 demonstrated Significant improvamefxf in 'cta^pre*hen3ion 
at the .05 level. , " ' ' 

The fourth grade sampljQ'was ejcceedingly small and nx) • significant 
improV'ement wats- dertdnstrated* 

Ij.. Factors thkt j4cilitated Accomplishments ; - /V>'^c ^ ' /f ^ 

The opportunity ^to diagnbse ^^tud35nt rQadlng deXicierxcies at an 
early age, -^nd there^ pr^ovidTs an individualized /i<:e;aai^^ 
based upon individuals needs,: was the iimjor,:f acto2>;:that: f acil- 
ita ted- abjective accon^lishment. 
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\ThQ cooperation of the classroom tedcher and the master teacher 
(Reading Specialist) in diagnoaing and planning the stiident's 
individualized readiog program also contributed to lobjecfive 

• a.ttainfcent. -. ''-r .'■ ' ■' ' ' • . ■ 

-••■.■'-•/ • • ' ^ ,^ 



Student OlS^ective Six -- Tbii rd Year — 1971-7U. 
Identiry learners with 'p.erceptufil 'and auditory deficiencies, 
ag^ five to' twelve, grades k-U, and prescribe and initiate 
a perceptual -auditory- education program for each deficient- 
learner. Afte.r >one year of treatment each learner will demon- 
strate significant gain in auditory and perceptual skills that 
are directly rejrated to the basic tasks of reading. 

Technique f®r Evaluation* „ - - 

It was impossible ta incorporate situdents from grades' 1/ 2, 
3 and 1+f therefore, the data available for analysis under ■ 
Objective S^x w*much le»4 than the originAL plan prescribed-. 

Two groups of kindergarten students who were- identified as. 

/' - ' ' ' 

ha Vina'- auditory or perceptual dysfunctions constituted the 

expe/iraental and control groups. The experimental group re- 
ceived six months of instruction using the perceptual/auditory 
.curriculum materials "developed at the University of Pittsburgh 
Poflttest^*scores the Gate s-MacGirii tie Re&dineas Test were 
obtained for both group.s and statistically analyzed via the . 
t-test, / <^ 



SiMmary Evaluation > / / . ' ^ : 

In terms of the original statementof Objective Six,%the r.esuDfcs 
reported in this- section can only be int;8rpr6ted".a3 partially, 
fultill]Lng this objective.; Sih,ce only kiniiergarten and post- 
■^test data were available,: the significant find¥ certainly •• 




diminish the internsa and exterht^l validity of the experiment. 
The ob^ectiye was attained for the kindertarten participants 
as indicated by/ the following table: J , * 




Test of Significance on Gates-MacGinitie Readiness 
Scores for Perceptual -Auditory Program in Student Ob^j. VI 



, 3 .. : 


• 

Groups" 


N 


Means 


Difference 


SE 


• t ' 


Experimental 
Control 


12 
21 


. 76^03^ 
. 65,52 


10.56 
* 




2.12* 


^ p .05^-^^ 

























This observed diffeirerice in postteat rraeans was 10.56 in favor 

of the experimental group^ This difference produced a t-Value 

' * ' , * * ' 

of 2.12 which was significant at the .05 level. 



Factors that l^aeilitated Accomplishment. 
, A master teacher utilizing the Ro^ner Visual, and Audi'tory 

Perceptual Skill's Program aa ^a kindergarte^n instru 6 tipnal 
.program. ' / . ^ , ^ ^ 



Program Obilectiva^ : ^. * . . ' * 

The^ goal of ^he original ^^pr^ogram was the development of a 
Langufige Arts Reading Center, Tliis was not written in per- ^ 

' f \ * \ J- 

formance terma but &n attempt is made to jQT^^^uate accomplishment|p 

Techni que for Evaluation > * ' ; ' ■ • * 

' ^^—5 ^: ' . ^ . 

Subjective evaluatio.n by the project dire^ctor based on baseline 

data, ^ Therefore the evaluation is based on three components 

which ,are: ' ' ' • 

First, was the Center established? 

SeconoVdid the Center aid teachers and students? 

Third, did: the Center have -a direct' effect upon the instructional 

^ .-^ 

program of teachers participating in the. project? 

Summary Evaluation > , ^ , \ / - 

1, The center was established and did serve as a reading/ - 

r 

language arts center.' It was utilized as an inservice train- 
ing center and as an instructional center- for students iden- 
tified as deficient readers. Teacher participation as demon- ^ 
sljrated by dissemination requests and attendance at the center • 
for workshops and .classroom" demonstration indicates successfuX . 
goal attainment,* . ' \ . . -^a • . 

T1i6 statistical gains demonstrated by the evaruation of the 
teacher and student objectives indicates that the center was ^ 
con tributlrig factor", \ - " ' . 



3* The dev0lppm6nt of learning;center8 in three of the -six . : 
participating sctpols can be att;?ibuted to' the Language Arts • 
and Reading Center/ ^ ; . ' ' . / 

Factars that "Facilitated Accordpilshment > . • ' , ' 

1... The Title III, E.S.E.A. program-. . • 

2. ' The consultants and Paderborn staff. " ' 

3. The leadership of the Smithton School District specifically 
Mr. Henry J. Mahat, Superintendent and Smith t^on School Baard\ 

1|. -The acceptance and need of teach^rg^^^ Southern Illinois^ 



SECTION II - B. GBJBgTIVESNOT ACCOMPLISHED. 

1. Teacher Objective Two. 

Teachers in. grades one, two and thrfee wil^ demonstrate com- 
petency to gcjsup students homogeneously for instruction in 
relation to s^ill deficiencies to 905^ perforniance criterion, 

2. Technique for EvalUatibn« . ^ • 
The mastery' technique was utilized for statistical evaluation, 
TheVteachers were req\iired to grpup students for instruction 



ase 




i upon the students demonstrated sQ}^l deficiency as 



assessed y>j the Stanford Diagnostic Reading Test , The teacher 



assessment was expected to correspond with the groviping of 
-four-.program reading experts 



/ 



Sxitmaary Evaluation^ ^ 
Eight of seventeen teachers attained the 90% performance 
criterion durir>g .tihe first project year, >or the^second pro- 
ject year four b|ir^?>fcinty-f our teachers agreed with tEe expei^ts 
•The teachers did at*tain competency in grouping students accord 
ing to their needs as determined by the Stanf ogd Diagnostic 
Reading Teat, 



Reasons for Failing to Acfe^mpli^h the Ob^jectlv^, 
The objective was poorly W^itit^iVr^ during the 

first project year were .actually ^rjiuping children according 
to a testing instrximent. The tes^' determined|^^ groupJ.ng 



1 



procedures; therefore, if the teachers read and followed the te-st 
mariufii they would^ attain 100^ competency'. 

A correction in the procediires was attempted for the second 
year and the teachers were expected to group according to 
criteria : established by utilizing thd results of grouping 
pez^l^rmed* by reading experts* The evaluation procedure 
established that the classification by the reading specialist 
might* be in error gj;* ^at least no more correct than the ; 
groupings done by the classroom teachers. • 

This objective was terminated after two years because the ob- 
jetJtive didn^t providi valid statistical results. 

The basic goal of the objective was ambitious byt the ^devel- 
opment of a statistical design that would return acceptable 
statistical data could not^be accomplished for the third pro- 
gram year. This objective would rl^quire a complete program.* 
In fact the objective mirrors^^whfu6"the university is attempting 
to accomplish in their diagnostic reading courses for teachers. 
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student Ob.lective Two^. 

Students in Grade's (1-3) (U-6) (5-?) in schools 'affected by 
Title in, E.S.E-rA. Paderborn Project will Indicate a greater 

f r 

satisfaction " ^ ' , * 

1) with school in general 

2) with reading as a subject 

3) .with self-achievement in reading than those students 

in the school not affected by Title III, E.S.E.A. 

> 

Technique for Evaluation^ 

Year-^One: A locally devised instriament was utilized. An 

aqalysis of ^ariance of Josttest scares ^was conducted. 

Year Two: /A locally gen^ated attitude aurvey was employed. 
A statistical t-test on posttest scores was conducted. 

Year Three: A standardized ^^rument was utilized. An ana^ 
ysis of covariance was employed on posttest scores. 

* - " ^ * ^ 

Summary Evaluation > 

Year One: Posttest scores j^ld^ no sigpificant difference. 

Tear Two: A statistical t-test posttest scores yielded 
no significant difference. • ' ^ • 

• 

Year Three: An ^ analysis of covariance . was employed an<i the 

adjusted posttest means revealed no significant differences 

Reasons for Failing to Accomplish the Ob.lective. 
The whole arpa of attitude measurement is cliff icult 'especially 
for the age^groups involved in the project.^ 
Attitudes are long-standing in nature, and there is some 
quest^^QO as to the ability of treatment, to change them in. % ~ * 
x-alatively short* traatmejjt period.*, 
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student dbiective Th3?ee, . . ^ 

Students in Experimental Group I, who actively engage family 
members in reading reinforcement activities. will show ^a^er 
gain in reading competency than those students in Experimental 
Group I 'Who do not so engage. 

Technique for Evaluation. . . 

Year One: Subjective eivaluatinn based on anecdotal data. 

Year Two: An andlysis o^f covariance was utilized wit6 the 
adjusted posttest means on the Stanford Diagnosti c 
Reading Gompgghension Subtest scores to compare groups. 

Summary Evaluation. • • 

Year^^e:^ Pg^r 'stajtistical design;', therefore data could not 
^De evaluated'. 

Yfear Two: No significant differences were obtained. 
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Reasons for Failing to Accomplish the Objective . ^ '^v 

.This objective was terminated at the end of the, second program 
year because of the 'difficulty in establishing an evaluation 
procedure that wo(ald ^Id beneficial data. This objective^ 




was global and therefore the scopi pf the program would ha^ 
had to have been expanded and this Wa3 financially impossible>A 
The meager statist*ical results indicates that aid at homd-.doss 
not aid the student's, achievement in school. In order to, 
verify this statement an extensive study must be )^onducted. 

~ ■ #6 . 



